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1. Introduction 

1.1. The Problem 

According to textbooks, the passage from classical mechanics to quantum mechanics is 
made by replacing Poisson brackets with commutators. However, this is an unreahsticaUy 
simple description of the situation, even for a basic example such as the classical phase 
space M^, with canonically conjugate variables x and p. One can associate a quantum 
operator C^- to a classical function f{x,p), but not in a completely unique way, because of 
what textbooks call the operator ordering problem. Regardless of how one defines Of, the 
map from classical functions / to quantum operators Of does not map Poisson brackets 
to commutators. Only if one restricts oneself to functions that are at most quadratic in x 
and p does one have the simple relation 

[Of,0,]=-thO{f,,y (1.1) 
1 



The notion of a function being at most quadratic in x and p is not invariant under 
canonical transformations. Quantizations of with different choices of what one means by 
linear or quadratic functions are not the same. One cannot conjugate one such quantization 
to another by a unitary map between the two Hilbert spaces that transforms the operators 
Of constructed in one quantization to their counterparts Of in another quantization. The 
order corrections to ( |1 . 1| ) are simply different in the two quantizations. 

The fact that quantization is ambiguous locally also means that it is not clear how to 
carry out quantization globally. Suppose that M is a 2n-dimensional classical phase space 
that we wish to quantize. (And suppose that we are given on M an additional structure 
known as a prequantum line bundle [|l],|^ ; this will enter our story shortly. ) Even if one can 
locally identify M with R^"^, this does not automatically tell us how to quantize M, even 
locally, since the quantization of M^"^ is not unique, as we have just explained. If we make 
random local choices in quantizing M, we cannot expect them to fit together to a sensible 
global quantization. There is also no good framework for trying to fit the pieces together, 
because there is no general notion of restricting a quantization of M to a quantization of 
an open subset of M, which would be a prerequisite for trying to quantize M by gluing 
together quantizations of open subsets. 

One cannot expect to be able to quantize M without some additional structure beyond 
its classical symplectic structure (and prequantum line bundle) . There is no known general 
recipe for what this additional structure should be. As a result, there is no general theory 
of quantization of classical phase spaces. 

In practice, quantization is a somewhat informal notion, which refers to a collection 
of loosely related procedures. The most important example in which we know what quan- 
tization should mean is M^" with a given choice of affine structure, that is, a choice of 
what one means by linear functions. This can be quantized in a way that requires no fur- 
ther choices. (In the usual procedure, one splits the linear functions into coordinates and 
momenta, which are then taken to act by multiplication and differentiation, respectively. 
The resulting Hilbert space admits a natural action of the symplectic group Sp{2n, M) or 
rather its double cover, and thus does not really depend on the splitting between coordi- 
nates and momenta.) Another important example is a cotangent bundle M = T*U (with 
the standard symplectic structure), which can be quantized in a natural way in terms of 
half-densities on U; similarly, there is a natural procedure for quantization of Kahler man- 
ifolds by taking holomorphic sections of the appropriate line bundle. Finally, if one knows 
how to quantize M, and G is a group that acts on M, then (under some mild restrictions) 
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one can define a quantization of tfie symplectic quotient M//G by taking tfie G-invariant 
part of the quantization of M. There are various ways to combine the procedures just 
mentioned. 

There is no guarantee that the different procedures are equivalent. If M is a cotangent 
bundle or a Kahler manifold in more than one way or a symplectic quotient of one of these 
in more than one way, or can be realized by more than one of these constructions, there is 
no assurance that the different procedures lead to equivalent quantizations. 

1.2. Quantization Via Branes 

In this paper, we offer a new perspective on quantization, based on two-dimensional 
sigma-models. The goal is to get closer to a systematic theory of quantization. However, 
it is not clear to what extent our perspective helps in computing new formulas. 

Our procedure is as follows. We start with a symplectic manifold M, with symplectic 
form w, that we wish to quantize. As in geometric quantization we assume that M 
is endowed with a prequantum line bundle £; this is a complex line bundle L ^ M with 
a unitary connection of curvature uj. 

For our purposes, saying that y is a complexification of M simply means that [X)Y 
is a complex manifold with an antiholomorphic involutional r :Y such that M is a 

component of the fixed point set of r; (2) the symplectic form of M is the restriction to 
M of a nondegenerate holomorphic two-form O on y, such that r*0 = O; (3) the unitary 
line bundle C M can be extended to a unitary line bundle C —^Y with a connection of 
curvature ReO, and moreover the action of r on y lifts to an action on £, restricting to 
the identity on M. These data are regarded as part of the definition of Y . 

The case of most interest in the present paper is the case that Y is an affine variety, 
which roughly means that it admits plenty of holomorphic functions. More precisely, an 
affine variety is defined by a finite set of polynomial equations for a finite set of complex 
variables opposed to a more general algebraic variety which is obtained by 

gluing together pieces which are each affine varieties. Our approach to quantization will 
be based on the A-model associated with the real symplectic form uy = ImO. So we 
need a further condition on Y which ensures that this theory has a good A-model. A 
good A-model is one in which the relevant correlation functions and other observables 
are complex- valued, rather than being functions of a formal deformation parameter. (For 

^ An involution is simply a symmetry whose square is the identity. 
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example, the most familiar A-model observables are obtained from sums over worldsheet 
instantons of different degrees. Having a good A-model means that such sums are not just 
formal power series but converge to complex- valued functions.) Y will have a good A- 
model if the supersymmetric sigma-model with target Y, which can be twisted to give the 
A-model, is well-behaved quantum mechanically; this in turn should be true if Y admits 
a complete hyper-Kahler metric, compatible with its complex symplectic structure. For 
instance, the example considered below and in more detail in section 3 corresponds to 
the Eguchi-Hansen manifold, which is a complete hyper-Kahler manifold. Having a good 
A-model should imply that deformation quantization of Y (which is part of the A-model, 
as we discuss below) gives an actual deformation of the ring of holomorphic functions 
on y, with a complex deformation parameter; a bad A-model merely leads to a formal 
deformation over a ring of formal power series. 

We require an actual deformation of the ring of functions, not just a formal one, for 
our approach to quantization to make sense. Interestingly, the conditions under which 
deformation quantization of an affine variety gives an actual deformation of the ring of 
functions on Y are very similar to the conditions for Y to admit a complete hyper-Kahler 
metric along the lines of the complete Calabi-Yau metrics constructed in . 

The most familiar A-branes are Lagrangian A-branes, supported on a Lagrangian 
submanifold of Y; such a submanifold is of middle dimension. In general 0, however, the 
A-model can also admit A-branes whose support has a dimension greater than one-half 
the dimension of Y. The support of such a brane is a coisotropic submanifold of Y with 
certain somewhat special properties. In particular, the choice of the line bundle C —>■ M 
with curvature ReO determines, in the language of 0, a canonical coisotropic brane in 
the A-model of Y. Its support is all of Y and it will be one of the main ingredients in the 
present paper. 

Suggestions that the A-model is related to deformation quantization (whose relation 
to quantization is discussed in section 1.4) go back to and and have been extended 
and made more precise in , partly in the framework of generalized complex geometry 
T^,|l2|. The canonical coisotropic A-brane was used in to elucidate some of these 



matters. For a related approach to the A-model, see 

We will also make use of ordinary Lagrangian A-branes. M itself is a Lagrangian 
submanifold, so (if M obeys a mild topological condition) we can define a rank 1 A-brane 
supported on M. Let us pick such a brane (there are inequivalent choices if M is not 



simply-connected) and call it B' . In this paper, we write Bcc for the canonical coisotropic 
A-brane, B' for a Lagrangian A-brane, and B for an A-brane of unspecified type. 

Quantization of M is now achieved by declaring that the Hilbert space associated 
to M is the space H of {Bcc, B') strings. This definition certainly gives a vector space 
associated to the choice of A-brane B' . That the explicit construction of this vector space 



is similar to quantization was originally shown by Aldi and Zaslow in examples and 
will be further discussed in section 2. 

To justify calling this process quantization, we need more structure. For one thing, we 
want to associate to B' not just a vector space but a Hilbert space. It is unusual to get a 
Hilbert space structure in the topological A-model, but in the present context, as explained 
in section 2.4, Ti can be given a hermitian metric by making use of the antiholomorphic 
involution r. The space 7i, with its hermitian metric, depends only on the choices of Y , 
£, and B' , and not on any additional data (such as a metric on Y) that is used in defining 
the A-model. We do not have a general proof that the hermitian metric on Ti is positive 
definite, though this is true near the classical limit. (A generalization of the construction, 
involving an antiholomorphic involution that maps M to itself but does not leave M fixed 
pointwise, leads to a hermitian metric on Ti that is not positive-definite near the classical 
limit.) 

If our procedure is reasonably to be called quantization, we also want to have a natural 
way to quantize a large class of functions on M, that is to realize them as operators on Ti. 
The functions on M that can be naturally quantized, in our approach, are the functions 
that are restrictions of holomorphic functions on Y that have a suitable behavior at infinity. 
The details of what is suitable behavior at infinity are tied to the question of what spaces 
have good A-models. However, for Y an affine variety (defined by a finite set of polynomial 
equations for a finite set of complex variables xi, . . . , x^), a reasonable condition is to allow 
only functions of polynomial growth (that is, polynomials in the Xi). This gives a very 
large class of holomorphic functions on such a variety, and it is for this class of functions 
that (under certain restrictions on Y) deformation quantization gives an actual rather 
than formal deformation. So this is the right class of functions to consider. For reasonable 
M gY , the restrictions of these functions are dense in the space of smooth functions on 
M, and our procedure leads to quantization in the sense of constructing a Hilbert space 
Ti with a map from a large class of functions on M to operators on ?-^. At the opposite 
extreme, if Y is compact, the definition of the Hilbert space Ti still makes sense, but we 
get no operators acting on this Hilbert space; one might not want to call this quantization. 
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To make this discussion a little more concrete, we will consider an example (which will 
be explored more fully in section 3) . Let M = 5''^ be a two-sphere, and let w be a symplectic 
form on M with u = 27rn, n G Z. We expect quantization to give a Hilbert space H of 
dimension n. The infinite-dimensional group Adiff 5"^ of area-preserving diffeomorphisms 
of S'^ acts on the classical phase space (M, w). The group that acts on H is U{n). There 
is no natural way to map Adiff S"^ to U{n), so any approach to quantization will involve 
some arbitrary choices. 

One standard approach in this problem (which in geometric quantization is known 
as picking a complex polarization) is to pick a complex structure J on 5"^, such that u 
is of type (1,1). The subgroup of Adiff S"^ that preserves J is at most SO{3), and it is 
convenient to pick J so that this subgroup is actually 5*0(3). If so, with some choice of 
coordinates, the Kahler metric on S'^ is a multiple of the round metric on the two-sphere 
x'^ + y'^ + z"^ = 1. Quantization is now straightforward: one defines H to be H^{S^,C), 
the space of holomorphic sections of C in complex structure J. Since the procedure of 
quantization was S'0(3)-invariant, the group SU{2) (the universal cover of 5'0(3)) acts 
naturally on 7i, as does its Lie algebra. The functions x, y, and z generate via Poisson 
brackets the action of this Lie algebra, so in this approach to quantization, these functions 
naturally map to quantum operators. One can then in a fairly natural way take polynomial 
functions in x, y, and z to act on 7i by mapping a monomial x°'y^z'^ to the corresponding 
symmetrized polynomial in the so (3) generators. 

Clearly, we could have embedded SO{3) in Adiff S"^ in many (conjugate) ways, so this 
approach to quantization depends on an arbitrary choice. Now let us discuss how one 
would quantize the same example in our approach. We are supposed to pick a suitable 
complexification Y of S'^. We do this by again picking coordinates in which S'^ is defined 
by the equation 

x^+y^ + z^ = l, (1.2) 

and we introduce Y by simply regarding x, y, and z as complex variables. Thus Y is an 
affine variety; it admits a complete hyper-Kahler metric (the Eguchi-Hansen metric), so 
we expect it to have a good A-model (the relevant deformation of the ring of functions on 
Y is explicitly described in section 3.1, and involves a complex parameter, not a formal 
variable). The allowed holomorphic functions are polynomials in x,y, and z subject to 
the relation ( p..2|) . On Y, there is a holomorphic two-form Q which restricts on M to the 
properly normalized symplectic form w; it is simply Q = ndx A dy/2z. The holomorphic 
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functions on Y with polynomial growth at infinity are simply the polynomials in x,y, and 
z, so the functions that we can quantize are those polynomials, just as in the previous and 
more standard approach. In the standard approach, the special role of a;, y, and z is that 
they generate via Poisson brackets symmetries of the complex structure that is used in 
quantization. In our approach, what is special about x, y, and z is that they generate the 
ring of holomorphic functions on Y with polynomial growth at infinity. 

It is illuminating to consider an alternative complexification of that does not work 
well. We can define the two-sphere by the equationll x"^ + y'^ + z^ = 1, for real variables 
X, y, z, so one can define a complexification Y of S'^ by letting x, y, and z be complex 
variables obeying the same equation. But deformation quantization of Y is only a formal 
procedure according to 0, and the construction of does not endow Y with a complete 
Calabi-Yau metric. Rather, Y admits an incomplete Calabi-Yau metric, which can be 
compactified to give a K3 surface. We expect that to give Y a good A-model, one must 
compactify it and consider the A-model of the K3-surface; then there are no holomorphic 
functions and no natural interpretation in terms of quantization. 

1.3. Comparison To Geometric Quantization 

Here and in section 1.4, we will compare our approach to some standard approaches 
to quantization. 

In geometric quantization [|],||, the first step, given (M, w), is to pick a prequantum 
line bundle £ — > M, that is, a unitary line bundle with a connection of curvature uj. This 
is also an initial step in our approach, as explained above, and probably (explicitly or 
implicitly) in any approach to quantization. The second step is then to pick a polarization 
(typical examples being a realization of M as a cotangent bundle T*U for some U, or a 
choice of Kahler structure on M) , after which quantization is carried out via half-densities 
on U or holomorphic sections of £ (S> K^^"^ M [K^/"^ is a square root of the canonical 
bundle of M). 

This second step has some drawbacks. A global polarization may not exist, even 
for phase spaces that should be quantizable. Moreover, if a polarization exists, there are 

^ To show that this equation defines a two-sphere, observe that if x, y, and z are real numbers 
obeying a;^ + + z'' = 1, there is a unique positive t such that (x, y, z) = t{x, y, z) obey + y^ + 
z^ = 1. This map gives an isomorphism between the space of solutions oi + y^ + z^ = 1 and 
the space of solutions of a;'* + y** + z'* = 1 . 
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many possible polarizations. It is not clear when quantization carried out with two different 
polarizations gives equivalent results. 

Our approach has analogous drawbacks. Given (M, u) , it is not clear whether a suit- 
able Y exists, or whether different choices of Y will give equivalent results. (We do not 
know of any examples in which this is the case.) Our approach is therefore particularly use- 
ful if there is a natural Y (or at least a natural class of Y^s with some special relationship), 
while geometric quantization is particularly useful if there is a natural polarization. 

The problem of when geometric quantization with two different polarizations gives 
equivalent results is vexing. The most important example is quantization of M^". Once 
one picks an affine structure on M^"^ (a notion of what one means by linear functions), a 
polarization can be picked by choosing a maximal Poisson-commuting set of linear func- 
tions which we declare to be the coordinates (as opposed to the momenta). 
Quantization is then carried out by introducing a Hilbert space of functions (actually half- 
densities) \l/(q'^, . . . , g"). We may call a choice of this kind a linear polarization. It is a 
classic result that quantizations with different linear polarizations (compatible with the 
same affine structure) are equivalent. The usual proof uses the action of the symplec- 
tic group Sp{2n,'R) (or rather its double cover), generated by quadratic functions of the 
coordinates and momenta. 

This fundamental example has others as corollaries. For G a subgroup of the sym- 
plectic group, consider the quantization of the symplectic quotient M = M?'^//G. Any 
G-invariant polarization of M^" descends to a polarization of M, and geometric quanti- 
zation of M with two polarizations that descend from G-invariant linear polarizations of 
M^n ^jjj |-,g equivalent. This statement, which follows from the equivalence of linear po- 
larizations of M?"^, also has an analog for n = cxd in the case of Chern-Simons gauge theory 

An example of a well-motivated procedure of quantization that is awkward to describe 
in geometric quantization is the case that M = M?"^ //G is the symplectic quotient of M^" 
(or some other space that can be quantized by geometric quantization) by a subgroup 
G C Sp{2n, M) such that there is no G-invariant polarization of M?"^. It is natural to define 
quantization of M by taking the G-invariant part of the quantization of M^", but this 
definition is not related in any obvious way to what one can get from a polarization of M. 

In our approach to quantization via branes, near the semiclassical limit, one may 
define the A-model of Y by picking a suitable metric on Y. This is the analog of a 
polarization in our approach. One illuminating and important case is that the metric on Y 
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is a complete hyper-Kahler metric and M is a complex submanifold in one of the complex 
structures, which we will call J. We will say that a metric of this kind gives a hyper-Kahler 
polarization of the pair (Y, M). In this case, J defines a complex polarization of M in the 
sense of geometric quantization, and the vector space H that is defined in our procedure 
(but not in general its hermitian inner product) agrees with what one would naturally 
define in geometric quantization, as we explain in section 2.3. 

The main advantage of our approach may be that the question of what can be varied 
without changing the quantization is perhaps clearer than it is in geometric quantization. 
As we have stressed, our answer to the question "Upon what additional data does a 
quantization of (M, to) depends?" is "It depends on the choice of the complexification 
Y with antiholomorphic involution r, holomorphic two-form O and line bundle 

The fact that different linear polarizations of M^" lead to equivalent quantizations is a 
special case of our statement. Given M?"^ with real- valued linear coordinates x^, . . . , x^" and 
symplectic structure u = X]i<j ^iodx"^ /\dx\ we define Y, Vt without breaking the Sp{2n, M) 
symmetry by complexifying the x* and setting O = J2i<j '^ijdx^ ^ dx^ . We define r to 
act by X* — > x*. Since Y is contractible, £ exists and is unique up to isomorphism, so 
in our approach, quantization of M^"^ endowed with an afRne structure is natural. The 
group Sp{2n, M) of symmetries of the structure (and in fact, its inhomogeneous extension 
to include additive shifts of the coordinates) must therefore act, at least projectively. 

1.4- Comparison To Deformation Quantization 



Deformation quantization [|T6[ is another matter. Unlike quantization, deformation 



quantization is a systematic procedure. Starting with a symplectic manifold M - or more 
generally, any Poisson manifold - deformation quantization produces a deformation of the 
ring of functions on M, depending on a formal parameter h. This can be done in a way 
that, up to a natural automorphism, does not depend on any auxiliary choice (such as the 
choices that are needed in quantization). The theory of deformation quantization has led 



to beautiful results [|T^ that can be expressed in terms of two-dimensional quantum field 
theory [18|, somewhat like our approach to quantization. 

Since deformation quantization is a formal procedure, it makes sense for complex man- 
ifolds. In other words, if y is a complex symplectic manifold (such as an affine variety) that 
admits many holomorphic functions, one can apply deformation quantization to deform 
the ring of holomorphic functions on Y to an associative but noncommutative algebra . 
Deformation quantization of the ring of holomorphic functions on Y requires no arbitrary 
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choices (beyond the structure of y as a complex symplectic manifold) but quantization 
does. 

However, deformation quantization is not quantization. Generically, it leads to a 
deformation over a ring of formal power series (in the formal variable h) , not a deformation 
with a complex parameter. It does not lead to a natural Hilbert space Ti. on which the 
deformed algebra acts. In our earlier example of quantizing a two-sphere whose area is 
2nn, quantum mechanics requires that n (which becomes the dimension of Ti) should be 
an integer, while in deformation quantization, h = 1/n is treated as a formal variable and 
there is no special behavior when is an integer. 

Generally speaking, physics is based on quantization, rather than deformation quan- 
tization, although conventional quantization sometimes leads to problems that can be 
treated by deformation quantization. For a well-known example, see [|19|. Our approach 
to quantization does have a relationship to deformation quantization. The relation is that 
deformation quantization of Y produces an algebra that then acts in the quantization of 
a real symplectic submanifold M G Y. (See p0|j21] , p2| for a similar perspective in the 
context of representation theory.) This will be explained in the next subsection. 

As already noted, in our framework, the existence of a good A-model for Y is supposed 
to ensure that deformation quantization of Y produces an actual deformation of the algebra 
of holomorphic functions, depending on a complex parameter h (or 1/n), not just a formal 
deformation depending on a formal parameter h. 

1.5. The Inverse Problem 

In describing our approach to quantization, we followed tradition and began with a 
symplectic manifold (M, uj) that one wishes to quantize. The solution to the problem 
involves picking a suitable complexification (y, O). 

There is an alternative approach in which the starting point is a complex symplectic 
manifold (y, O), together with a unitary line bundle £ — > y of curvature ReO. The 
following discussion is most interesting if Y has plenty of holomorphic functions. This is 
so if y is an afhne variety, such as the variety -t- -t- 2^ = 1 that featured in the example 
that we discussed previously. 

Then one considers the A-model of Y in symplectic structure ujy = ImO. The choice 
of C enables us, following |||] and [Q, to define a coisotropic A-brane Bcc, whose support is 
all of y. For any A-brane B, the space of (i3, B) strings is a Z-graded associative algebra. In 
the present case, additively, the space of (i3cc, Bcc) strings is just the space of holomorphic 
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functions on the complex manifold Y. However, in the A-model, the commutative ring of 
holomorphic functions is deformed. The first order deformation is by the Poisson bracket, 
and the higher order corrections (which can be computed in sigma-model perturbation 
theory, somewhat as in [0) are controlled by associativity. Thus the space of {Bcc,Bcc) 
strings is an associative but noncommutative algebra A that we can think of as arising 
from deformation quantization of Y. As we have stressed, if Y has a good A-model, this 
deformation involves an actual complex parameter, not a formal one. Moreover, if Y 
admits a good A-model, its symmetries that preserve a coisotropic A-brane Bcc will act 
on A as automorphisms. In our approach, these are precisely the symplectomorphisms 
of the complex symplectic manifold {Y,Q). This is closely related to what one finds in 
deformation quantization of Y when it produces an actual deformation of the algebra of 
holomorphic functions, not just a formal deformation (see for a detailed discussion of 
the affine space). 

If we are interested in quantization, as opposed to deformation quantization, we need 
something smaller that A acts on. For this, we note first that if B is any other A-brane, 
then by general principles A acts on the space of {Bcc, B) strings. Now, pick to be a 
conventional Lagrangian A-brane, supported on a Lagrangian submanifold M G Y. We 
denote this brane as B' . Then the space H of {Bcc,B') strings admits a natural action of 
the algebra A. 

Now suppose further that M has been chosen so that Kefl remains nondegenerate 
when restricted to M. Analysis of the {Bcc, B') strings, as first considered in examples in 
T^ , relates Ti to quantization of M with symplectic structure Re O. But how can we get in 



this framework a hermitian inner product - usually understood as one of the main points 
of quantization? For this, we need one more piece of data: an antiholomorphic involution 
T : Y Y that obeys r*0 = O, maps M to itself, and lifts to an action on C. With 
the help of r (and more standard ingredients, such as CPT symmetry), one can define a 
hermitian inner product on 7i, with the property that holomorphic functions on Y that 
obey r(/) = / act on 7i as hermitian operators. Near the classical limit, the hermitian 
inner product is positive definite if and only if r leaves M fixed pointwise. 

A noteworthy point here is that the algebra A only depends on the input data Y, O, £, 
and not on r. If r does not exist (or M is not a component of the fixed point set of any 
r), then everything that we have said goes through, except that TC is not endowed with a 
natural hermitian metric. 
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Alternatively, Y may admit several different antiholomorphic involutions, say r and 
t'. Let M and M' be components of the fixed points sets of r and r' (and suppose that 
Re Cl is nondegenerate when restricted to either one) . Then we can quantize either M or 
M' by the above procedure, giving Hilbert spaces H and H'. The same algebra A will act 
in either case. Functions that are real when restricted to M will be hermitian as operators 
on 7^, and functions that are real when restricted to M' will be hermitian as operators on 

n'. 

There are far more choices if we are not interested in a hermitian metric. Then M 
can be the support of any rank 1 A-brane, and the same algebra A acts on the space 7i 
that we obtain by quantizing M, regardless of what M we pick. 

The A- Model 

So far we have emphasized two points of view about this subject. 

In the first approach, the starting point is the real symplectic manifold (M, u) that 
we wish to quantize. The problem is solved by complexifying M to a complex symplectic 
manifold (F, Q) that has a good A-modcl for symplectic structure u>y = Imn. 

In the second approach, the starting point is the complex symplectic manifold {Y, Q). 
Picking a suitable coisotropic brane Bcc, assumed to be an ^-brane with respect to coy = 
ImQ, we deform the algebra of holomorphic functions on y to a noncommutative algebra 
A. Then picking another ^-brane, we get a module for A. 

A third approach, and the most natural one from the point of view of two-dimensional 
topological quantum field theory, is to emphasize the ^-model of Y, regarded as a real sym- 
plectic manifold with symplectic structure ujy. There may be many inequivalent choices of 
space-filling coisotropic ^-brane Bcc on y - corresponding to diflPerent choices of a complex 
structure / on y for which there is a holomorphic two- form Q with ujy = Imfi. For each 
choice of such a brane Bcc, we get a noncommutative algebra A that acts on the space of 
{Bcc, B') strings, for any other A-brane B' . If M is the support of B' , the space of {Bcc, B') 
strings gives a quantization of M whenever ReO is nondegenerate when restricted to M. 
Thus, the same A-model can lead to quantization of M in difi'erent symplectic structures. 

1.6. Organization Of This Paper 

In section 2, we will describe in more detail our ^-model approach to quantization. 
Section 3 is devoted primarily to analyzing in more depth the example related to 
M = S'^. This example is surprisingly rich and related to representation theory of SL{2, R) 
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as well as SU (2). In this paper, we consider primarily the case of those groups, but actually, 
as we explain at the end of section 3, the example has a generalization in which M is a 
coadjoint orbit of a semi-simple real Lie group of higher rank, and Y is the corresponding 
orbit of its complexification. This leads to a perspective on the representations of semi- 
simple real Lie groups, similar to that of R. Brylinski 

Finally, in section 4, we discuss from the present point of view one of the few known 
examples in which the subtleties of quantization are actually important for quantum field 
theory. This is three-dimensional Chern-Simons gauge theory. 

2. Basic Construction 

2.1. The A-Model And The Canonical Coisotropic Brane 

We begin with a complex symplectic manifold Y, that is, a complex manifold endowed 
with a nondegenerate holomorphic two-form O. Though we will not assume that Y has a 
hyper-Kahler structure, it is convenient to use a notation that is suggested by the hyper- 
Kahler case. We write / for the complex structure of Y, and we denote the real and 
imaginary parts of O as uj and ujk- 

Q = uj + iuK- (2-1) 

Since O is of type (2, 0), we have /*0 = zO, or 

= -ljk, I^^k = ^j- (2.2) 

(We regard / as a linear transformation of tangent vectors; /* is the transpose map acting 
on one- forms. O and /*0 are maps from tangent vectors to one- forms.) 

In this paper, we view 1" as a real symplectic manifold with symplectic structure 
ujy = ^K, and we study the associated A-model. The most familiar branes of the A-model 
are Lagrangian branes, supported on a Lagrangian submanifold that necessarily is of middle 
dimension. However [|^, in general it is also possible to have an A-brane supported on a 
coisotropic submanifold Z d Y whose dimension exceeds half the dimension of Y . For 
our purposes, we are interested in a rank 1 coisotropic A-brane whose support is simply 
Z = Y . Like any rank 1 brane, such a brane is endowed with a unitary line bundle C with 
a connection whose curvature we call F. The necessary condition for such a brane to be 
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an A-brane is that / = Uy^F should square to —1, in which case one can show that / is 
an integrable complex structure. 

This is a rather special condition, but there is a simple way to obey it that was 
important in and will also be important in the present paper. We simply set F = coj, 
in which case Wy^F = uj~^^ujj, which coincides with / according to eqn. ( |2.2|) . 

Thus, starting with the complex symplectic manifold {Y, Q) , for any choice of a unitary 
line bundle C with a connection of curvature loj = ReO, we get an A-brane in the A-model 
of symplectic structure coy- We call this A-brane the canonical coisotropic brane and denote 
it as Bcc- 

To make the A-model of symplectic form ujy concrete, it is usual to introduce an 
almost complex structure with respect to which uy is positive and of type (1, 1). This 
enables one to develop a theory of pseudoholomorphic curves in Y, leading to an A- mo del 
that depends only on ujy and not on the chosen almost complex structure. There is no 
need for the almost complex structure to be integrable. In the present case, since the 
symplectic structure of the A-model is ujy = ujk, it is natural to write K for the almost 
complex structure that is used to define the A-model. 

To write the sigma-model action, one also uses the associated metric g = —ujkK. 
Furthermore, it is always possible to pick K so that IK = —KI, implying that J = KI is 
also an almost complex structure. J will be useful in the quantization. 

We stress that we make no assumption that J and K are integrable. A K with the 
stated properties {uk is of type (1, 1), and IK = —KI) always exists, and moreover the 
space of choices for K is contractible. To see this, let Y be of real dimension 4n. Let 
Sp{2n) be the compact form of the symplectic group acting on C^", and Sp{2n)c its 
complexification. The choice of /, O reduces the structure group of Y from GL(4n, M) 
to Sp{2n)c- The further choice of K reduces this group to Sp{2n). (We have Sp{2n) = 
U{2n) n Sp{2n)c, where U{2n) is the subgroup of G'L(4n, R) that commutes with K.) As 
the quotient space Sp{2n)c/ Sp{2n) is contractible, a global choice of K can be made, and 
there is no topology in the choice of K. 

Though J and K need not be integrable, certainly the nicest case is that Y admits a 
complete hyper-Kahler metric in which the three complex structures are /, J, and K and 
the metric is g = —ujkK. (We call this a hyper-Kahler polarization.) In general, we cannot 
assume this, but many standard facts about the hyper-Kahler case are true in greater 
generality. For instance, it follows from IK = —KI that uj is of type (2, 0) © (0, 2) with 
respect to K. Indeed, the fact that ujk is of type (1, 1) with respect to K can be written 
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K^ujkK = ujk, which by ( p72|) is the same as —K^PujjK* = ujk, or PK^ujjK = uk- 
With = — 1 and using ( P72| ) again, this is K^ujK = — wj, which is equivalent to saying 
that uj is of type (2, 0) © (0, 2) with respect to K. It now foUows from J = KI that uj is 
of type (1, 1) with respect to J. (We have J^ujJ = PK^ujKI = uj, since uj is of type 
(2, 0) © (0, 2) with respect to both / and K.) 

The relation between J and K is completely symmetrical; instead of beginning with 
K, and then defining J, we could have begun by introducing an almost complex structure 
J, constrained so that IJ = —JI and ujj is of type (1, 1) with respect to J. The same 
argument as above would show existence of J, and then we could define K = IJ, arriving 
at the same picture. As an example of this viewpoint, suppose we are given a middle- 
dimensional submanifold M G Y such that coj is nondegenerate along M, and such that 
the tangent space TY to Y, when restricted to M, has a decomposition TY = TM(Bl(TM), 
where TM is the tangent space to M. Then we can constrain J along M so as to preserve 
the decomposition TY = TM © I{TM); we simply define J on TM by picking an almost 
complex structure on M such that ujj is of type (1, 1), and then define J on I{TM) to 
ensure IJ = —JI. Having defined J along M, there is no topological obstruction to 
extending it over Y, again because Sp{2n)c/ Sp{2n) is contractible. 

2.2. Space of {Bcc^^cc) Strings 

Our next problem is to identify the algebra A of (-Bcc, Bcc) strings. 

First we describe the space of (-Bcc, ^cc) strings additively. The space of {Bcc, Bcc) 
strings in the A-model is the same as the space of operators that can be inserted in the 
A-model on a boundary of a string world-sheet E that ends on the brane Bcc- So let us 
determine this. 

We write X for the bosonic fields in the sigma-model with target Y, and "i/^-, '0+ ^or 
left- and right-moving fermionic fields. A boundary operator must be invariant under the 
supersymmetry (or BRST) symmetry of the A-model. The general A-model transformation 
law of X is 

SX = {l-iK)ij+ + {l + iK)t(;-. (2.3) 

Here we use an arbitrary almost complex structure K (relative to which u)k is of type 
(1,1) and positive) in defining the A- model of symplectic structure ujk- A simple type of 
local operator is an operator f{X) derived from a complex- valued function f : Y —>■ C. For 
such an operator, inserted at an interior point of E, to be invariant under (pT3|), / must be 
constant. 
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However, we are interested in boundary operators, rather than bulk operators, and 
for this we must consider the boundary condition obeyed by the fermions. For a general 
space-filling rank 1 brane, this boundary condition is 

i;+ = {g-F)-\g + F)i;_. (2.4) 

In the present case, with F = uj, we have {g — F)~^{g + F) = J. So for boundary 
operators, ( |2.tj| ) collapses to dX = ((1 — iK)J + (1 + iK)) ?/'_, which is equivalent to 

6X = + + J)t(;-. (2.5) 

If we decompose 5X as S^'^^X + 6^'^X, where the two parts of the variation are of type 
(1, 0) and type (0, 1) with respect to /, then 

S^^^X = 

(2.6) 

S^'^X = p, 

where p = (1 + + J)i{j-. Clearly, since the square of the topological symmetry of the 
A-model vanishes, ( |2.6| ) implies that 

6p = 0. (2.7) 

From ( |2.6| ), we see that for a string ending on the canonical coisotropic brane, a 
boundary operator f{X) preserves the topological symmetry of the A-model if and only 
if the function / is holomorphic in complex structure /. More generally, all boundary 
observables of the A-model can be constructed from X and p, which have dimension 0, 
since other fields have strictly positive dimension or vanish at the boundary. If we pick 
local complex coordinates on Y corresponding to fields X^, then a general operator of q^'^ 
order in p takes the form p^^ p^'^ ...p^^j^^^^ ^ (X,X) and has charge q under the ghost 

number symmetry of the A-model. By interpreting as dX^ , we can interpret such an 
operator as a (0, q')-form on Y. Then it follows from ( |2.6| ) and ( |2.7| ) that the topological 
supercharge of the A-model corresponds to the d operator of Y. 

So the observables of the A-model correspond additively to the graded vector space 
H^'*{Y) (where Y is viewed as a complex manifold with complex structure /). For our 
purposes in this paper, we are mainly interested in the ghost number zero part of the 
ring of observables. Additively, this corresponds simply to the holomorphic functions 
on Y. However, the multiplicative structure is different. Classically, the holomorphic 
functions on Y generate a commutative ring, but in the A-model, in the special case of a 
brane of type Bcc, this ring is deformed to a noncommutative ring that we call A. The 
deformation corresponds to deformation quantization using the Poisson brackets derived 
from the holomorphic symplectic two-form O. One explanation of how this deformation 
comes about is given in section 11.1 of H. 
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2.3. Lagrangian Brane And Quantization 



cc 




'B 



Fig. 1: An open string with [Bcc,B') boundary conditions. 



So far, we have obtained an algebra A of (-Bcc, Bcc) strings. Now we want to find 
something (other than itself) that A can act on. The immediate answer is to introduce a 
second A-brane B' . Then A acts naturally on the space of {BcciB') strings (fig. 1). 

For this paper, we will consider B' to be an A-brane of the simplest possible kind: a 
Lagrangian A-brane of rank 1. Thus, B' is supported on a Lagrangian submanifold M and 
endowed with, roughly speaking, a fiat line bundle C . The natural objects of study in what 
follows are branes, and it is important to bear in mind some subtleties about the relation 
between Lagrangian submanifolds and branes. First, because of disc instanton effects, 
not every pair (M, C) defines an A-brane. Second, in the absence of such effects, if two 
pairs (M, C) and (M', C") differ by Hamiltonian isotopy, then the associated A-branes are 
equivalent. Finally, the interpretation of C as a fiat line bundle is oversimplified, because 
of the relation of branes to iiT-theory and the role of the S-field. Each of these effects will 
play some role later. 

To relate branes to quantization, we will impose a condition on M that has no analog 
in the usual theory of the A-model. We assume that ujj is nondegenerate when restricted to 
M. This is a mild condition in the sense that, acting on the tangent space to a given point 
in y, ujj is nondegenerate when restricted to a generic even-dimensional plane. Hence if 
the condition is true for a submanifold M, it is true for any sufficiently nearby submanifold. 
(The opposite case that ujj is zero when restricted to M was investigated in section 11 of 
0, and leads to P-modules. We return to this in section 3.9.) 

17 



If ujj is nondegenerate when restricted to M, then the pair (M, ujj) is a symplectic 
manifold, and this is the symplectic manifold that we will quantize. 

As explained in section 2.1, to define the ^-model, we pick an almost complex structure 
with respect to which ujk is of type (1,1), and such that /, and J = KI obey the 
algebra of quaternions. Once M is given, it is convenient to further constrain K such that 
the tangent bundle TM is J-invariant. (That one can do so was explained at the end of 
section 2.1.) 

We now want to show that quantization of (i3cc, B') strings leads to quantization of 
the symplectic manifold (M, ujj) . To see this, we describe the sigma-model on a Riemann 
surface E, as in section 2.2, by bosonic fields X that describe the sigma-model map $ : 
E ^ y, and left and right-moving fermionic fields if)- and '(/'+• In general, the boundary 
conditions for fermions at the end of an open string are ipj^ = Rip-, for some matrix R. 
In the case of a space-filling brane of rank 1, such as Bcc, 

R^{g-F)-\g + F). (2.8) 

Here g is the metric of Y and F is the curvature of the Chan-Paton line bundle. For the 
brane Bcc, we have F = uj and R = J, so the boundary condition is 

ip+ = Jip_. (2.9) 

For a Lagrangian brane, supported on a submanifold M, F = but this does not 
mean that R= 1. Rather, the boundary condition is 

i;+=n'ilj_, (2.10) 

where TZ : TY\m — TY\m is a refiection that leaves fixed the tangent bundle TM to 
M, and acts as —1 on the normal bundle to M (here TY\m is the tangent bundle of Y 
restricted to M). 

For our problem, we are principally interested in {Bcc, B') strings, that is strings that 
couple to Bcc on the left and to B' on the right. The boundary conditions are thus 

V^+(0) = JV'_(0) 

(2.11) 

ip+in) = 7^?A-(7r), 

where and tt are the endpoints of the string. These boundary conditions do not allow 
ip to be constant along the string. For example, if ip is tangent to M and also constant. 
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the combination of the two boundary conditions gives '0+ = J'i/'+? which since i/'l is real 
and = —1 imphes that tpj^ = 0. Similarly, if is normal to M and constant, we get 
'0+ = —Ji{j+, again implying that '0+ = 0. 

Now let us discuss the bosonic fields X{a, r), where a and r are the worldsheet space 
and time coordinates. The bosonic fields do have zero modes, because the boundary 
condition *dX = RdX is consistent with constant X; likewise the classical equations of 
motion are obeyed if X is constant. The usual zero mode structure of the bosonic string 
is X = a: + + . . ., where x is the zero mode, p is its canonical momentum, and . . . are 
the nonzero modes. Here, usually x is canonically conjugate to p. In the present case, 
there is a constant x term, but there is no pr term in the expansion, because as soon as 
X becomes r-dependent, the boundary condition *dX = RdX at a = does not permit 
X to be independent of a. Usually, in sigma-model perturbation theory, this effect can 
be treated perturbatively because R is close to 1; but for a boundary associated with the 
brane Bcc, we have R^ = —1, so there is no way to expand around R = 1. The result is 
that the pr term is missing in the expansion, which reads 

X = x + (2.12) 

where the omitted terms are nonzero modes. The nonzero modes are, of course, related by 
worldsheet supersymmetry to the nonzero modes of ip. For a detailed explanation of this 



expansion in an example, see [14 



In the context of quantizing the (i3cc, B') strings, in addition to the boundary condition 
at o" = 0, there is also a boundary condition X{n) G M at the other end. Because of this 
boundary condition, the zero modes in ( |2.12| ) take values in M. 

So it must be that the components of x are canonically conjugate to each other. The 
reason that this happens is that the action of a string ending on a brane with Chan-Paton 
connection A contains a boundary term J^^ dXf^. In the case of {Bcc, B') strings, the 
Chan-Paton bundle C of the brane B' is flat, while the Chan-Paton bundle of Bcc is the 
unitary line bundle C of curvature ujj. We write A and A' for the connections on these two 
line bundles. Classically, the action for the zero modes is J dT{A^ — A'^)dx^ /dr, where the 
two terms come from the left and right endpoints of the string. We define a line bundle 
M = C ® over M. A/" is a unitary line bundle with a connection B = A — A' oi 

curvature ujj. The action for the zero modes is, in this approximation, 

Bf^^dT. (2.13) 
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Formally speaking, to quantize the zero modes with this action (which actually has 
an important "quantum" correction that we will describe shortly) amounts to quantizing 
M with prequantum line bundle jV. Just knowing this does not give any general solution 
to the problem of quantization. All we learn is that, if the A-model of Y exists, then the 
space of (Bcc, B') strings can be understood as the result of quantizing M with prequantum 
line bundle A/". If the A-model exists, and the two boundary conditions associated with 
branes Bcc and B' also exist, then the space of {Bcc,B') strings exists even if it is hard to 
describe this space explicitly. 

Usually, given two ^-branes or S-branes Bi and B2, one can go to a large volume 
limit and describe the space of (^1,^2) strings in terms of classical geometry. The delicate 
structure of the coisotropic brane Bcc prevents us from doing this successfully for the 
{Bcc, B') strings, in general. 

But we can use general properties of the ^-model to learn general properties of quan- 
tization. One can also get some information from classical geometry, as we explain next. 

Branes Of Type (A, S, A) 

There is an important special case in which we can describe explicitly the space of 
{Bcc, B') strings. This is the case that we are given a hyper-Kahler polarization of (Y, M). 
This is a hyper-Kahler structure on y, extending its complex symplectic structure {I,Q), 
such that M is a complex submanifold in complex structure J. 

Under these conditions, the branes {Bcc, B') are both branes of type {A^ B, A), that is, 
^-branes for the ^-models with symplectic forms a;/ or ujk, and 5-branes for the S-model 
of complex structure J. For example, Bcc is a 5-brane of type J because the curvature 
form ujj of its Chan-Paton line bundle is of type (1, 1) in complex structure J. Similarly, 
B' is a S-brane because M is a complex submanifold and the Chan-Paton bundle of B' is 
flat. 

We can now look at the space of {Bcc, B') strings in two different ways. We defined Ti 
to be the space of {Bcc, B') strings in the A-model of uy = ^^k- Similarly, we can define H 
to be the space of {Bcc,B') strings in the S-model of complex structure J. As long as M 
is compact or wavefunctions are required to vanish sufficiently rapidly at infinity, the two 
spaces are the same, since they both can be described as the space of zero energy states 
of the sigma-model with target Y (compactified on an interval with boundary conditions 
at the two ends determined by Bcc and B'). 

20 



One qualification is that the equivalence of Ti and Ti does not respect their grading. Ti 
and 7i are both Z-graded, because the A-model of type uk and the S-model of type J are 
both Z-graded by "ghost number." The gradings are different, but conjugate. In fact, the 
sigma-model of target Y , with boundary conditions set by two branes of type (A, S, A), has 
an SU{2) group of i?-symmetries that we call SU{2)ji; the two ghost number symmetries 
are conjugate but different ^7(1) subgroups of SU{2)ji. In practice, however, one usually 
studies quantization in a situation in which the grading is trivial; this is so if J\f is very 
ample clS Si line bundle in complex structure J. 

To use the equivalence between H and 7i, we need to have a way to determine H. For 
this, we simply observe that in the S-model, the choice of Kahler metric is irrelevant. So 
we can rescale the metric of y by a factor t ^ 1, reducing to a situation in which sigma- 
model perturbation theory is valid. In this limit, by a standard argument, we describe 7i 
by d cohomology: 

n = ©fi7^if^ (M, ^1/2 ® AT) . (2.14) 
Since TC ^ H, we can express this as a statement about H: 

n = ®f^^^W{M,K^/^®Af). (2.15) 

Here, roughly speaking, K^/'^ is the square root of the canonical line bundle K of M. (A 
more precise explanation is given presently.) For very ample A/", the cohomology vanishes 
except for i = and its Z-grading is trivial. 

The description (|2.15 ) of Ti has an important limitation, beyond the problem with 



the grading. It describes 7i as a vector space, but it does not lead to a natural description 
of the Hilbert space structure of Ti, when there is one. In section 2.4, we will describe 
the conditions under which Ti. has a hermitian inner product that can be defined in the 
A-model. Analogous but different condition^ lead to a natural hermitian inner product 
on Ti in the S-model. The two hermitian structures are different (when they both exist) 
and the equivalence between Ti. and Ti. does not map a natural hermitian structure of 
the A-model to a natural structure of the S-model. (This identification does preserve a 
third hermitian product, the one that 7i and 7i get from their interpretation as the space 
of physical ground states in the sigma-model with hyper-Kahler metric. This one is not 



^ To define a hermitian metric in the i?-model, one uses an involution r of F that maps M to 
itself and reverses the sign of J, while in the ^-model, r reverses the sign of u^y, as explained in 
section 2.4. 
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natural in the A-model or the S-model and is not visible in the large volume limit that 
leads to ( p.l4|) .) Hence, when applicable, ( |2.15|) describes 7i as a vector space, not as a 
vector space with a hermitian inner product. 

The description of 7i that we have just given has an obvious resemblance to a standard 
statement in geometric quantization. In that context, the choice of an integrable complex 
structure J on M, such that the symplectic form of M becomes a Kahler form, is known as 
a complex polarization. Eqn. (|2.15|) then defines quantization with a complex polarization. 

A hyper-Kahler polarization of the pair {Y, M) , which we used in the above derivation, 
plays an analogous role in our approach. Our statement is that for any choice of hyper- 
Kahler polarization, the space of {BcciB') strings can be described as in ( |2.15| ). 

There are two primary differences between our statement and the analogous statement 
in geometric quantization: 

(1) In our framework, the space of {Bcc, B') strings is an A-model invariant and there- 
fore is independent of the choice of a hyper-Kahler polarization. In geometric quantization, 
there is no general statement about when the right hand side of ( p.l4| ) is independent of 
the choice of complex polarization J. 

(2) In our framework, ( |2.14| ) is a statement about vector spaces, while in geomet- 
ric quantization, one usually endows the right hand side of ( p.l4|) with a hermitian 



structure. For example, in the very ample case, one defines a Hilbert space norm by 
I'i/'P = /^((^""/n !)'(/''!/', where ui is the symplectic form of M, 2?! is the real dimension of 
M, and G H^{M, K^l"^ ®Af). This is certainly a natural formula in Kahler geometry (it 
describes the hermitian metric that arises in the sigma-model after rescaling the metric of 
y by a factor t ^ 1), but it is not a natural A-model inner product. A somewhat related 
statement is that in our framework, ( p.l4| ) does not describe the natural Z-grading of Ti, 
but a conjugate one. 

Relation To K -Theory 

A point that still remains to be clarified is the meaning of the symbol K^/'^ in the 
above analysis. In general, M may not be a spin manifold, so a line bundle K^/'^ may not 
exist, and M may not be simply-connected, so that if K^^"^ exists, it may not be unique 
up to isomorphism. 

The resolution of this point depends upon the relation of branes to E'-theory. The 
following are general statements about branes, independent of any specialization to an A- 
model or a S-model. Consider a brane supported on a submanifold N G Y and endowed 
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with a rank 1 Chan-Paton bundle T. Naively, T is a complex line bundle, but actually, 
because of an anomaly in the sigma- model ||2^, T can be more precisely described as a 
Spin^ structure on the normal bundle to in y. 

For the space-filling brane Bcc, N is equal to Y, so the normal bundle to is trivial. 
Hence the Chan-Paton bundle C of Bcc is an ordinary complex line bundle. For the 
Lagrangian A-brane B' , N is the Lagrangian submanifold M. The tangent bundle and 
normal bundle to a Lagrangian submanifold are naturally isomorphic (under multiplication 
by uy = ujk)j so the Chan-Paton "line bundle" C of B' is really a choice of Spin^ structure 
on M. If C were actually a line bundle, there would be no natural line bundle ® 
K^/"^, since K^/"^ may not exist and may not be unique. However, for C a Spin^ structure, 
there is a natural line bundle {C')~^ -ftT^/^; the two factors in this tensor product are not 
naturally defined as complex line bundles, but the tensor product is. 

Now the meaning of ( |2.14D is clear. With A/" = {C')~^ , and C an ordinary complex 
line bundle, there is no problem in defining Af ® K^^'^ as a complex line bundle, though 
the two factors separately do not have this status. 

In this discussion, we did not assume that the rank 1 brane supported on is supposed 
to be an A-brane or a S-brane. If this brane is supposed to be an A-brane supported 
on a Lagrangian submanifold M, then C must be a fiat Spin^ structure on M. There 
is a topological obstruction to having a Spin^ structure on M, and there is a further 
obstruction to having a fiat Spin^ structure. In general, Spin^ structures on M are classified 
topologically by the choice of a way of lifting the second Stieffel- Whitney class W2 (M) G 
i7^(M, Z2) to an integral cohomology class ( G i7^(M, Z). Flat Spin^ structures are 
classified by a choice of a lift C such that ^ is a torsion element of H^(M, Z). In general, 
even if M is Spin^, it may not admit a fiat Spin^ structure, since it may be impossible to 
pick the lift C to be a torsion class. A symplectic manifold that does not admit a fiat Spin^ 
structure cannot be quantized in our sense. 

This obstruction to quantization has been encountered in the literature on represen- 
tations of a semi-simple non-compact real Lie group G. In that context, M is a coadjoint 
orbit of G, and one aims to obtain a representation of G by quantization of M. (See section 
3 for more on this.) This problem has been approached from many different points of view. 
In [^, which is perhaps the closest to the approach in the present paper, a preliminary 
step to quantizing M is to, in effect, endow M with a fiat Spin^ structure. For example, 
the minimal orbit of SO{j>, q) with p + q odd and p,q > 4 does not admit such a structure 



and cannot be quantized by the methods of [|0| or of the present paper. 
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General Shift By K^l'^ 

Now let us return to the zero mode action ( p.l3|) 



Sp^c/r, (2.16) 

dropping the assumption of a hyper-Kahler polarization. In the original derivation, B 
emerged as a connection on the "complex line bundle" M = L® However, as we 

have just explained, in general M does not make sense as a complex line bundle. 

Simply to make sense of the formula, there must be a correction that shifts M to 
M = L ® {CJ^~'^ ® K^/"^ (or something similar to this), where K is the canonical line 
bundleil of M. The connection that appears in the action must be a connection on M. 

The way that this correction arises is as follows. As a step toward quantizing the 
open strings with (i3cc, B') boundary conditions, one quantizes the worldsheet fermions, 
expanding around a map from the string worldsheet to Y that consists of a constant map 
to a point p & M. In expanding around such a constant map, there are no fermion zero 
modes, since they are all removed by the boundary condition (|2.11| ). Hence, the space of 



ground states in the fermion Fock space is a one-dimensional vector space Wp. As p varies, 
Wp varies as the fiber of a complex "line bundle" W M. W and the induced connection 
on it must be included as an additional factor in quantizing the bosonic zero modes. 

In fact, W is isomorphic to i^T^/^ (and is not quite well-defined as a line bundle because 
of an anomaly in the relevant family of fermion Fock spaces). One can show that W = K^/'^ 
by using standard methods to determine the quantum numbers of the Fock space ground 
state. This result is also needed to match the S-model analysis in the case that one uses 
a hyper-Kahler polarization. 

2.4- Unitarity 

So far, to an A-brane B' , we have associated a vector space H consisting of {Bcc, B') 
strings. Quantum mechanics usually involves Hilbert spaces, however, and the question 
arises of how to define a hermitian inner product on Ti. 

For this, we want to make a general analysis of how a hermitian inner product can 
appear in the topological A-model. In this general discussion, we are only concerned with 



^ The metric on Y that is used to define the A-model, even if it is not hyper-Kahler, restricts to 
a metric on M. The metric on M, together with the symplectic structure, determines an almost 
complex structure on M, and this almost complex structure is used to define K. 
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the topological ^-model with symplectic structure ujk- (Additional structures such as / 
and ujj are not relevant.) 

If Bi and B2 are two branes in the topological ^-model, there is always a natural 
duality between the space of (81,82) strings and the space of {82-, 81) strings. It is given 
by the two point function on the disc. Consequently, defining a hermitian inner product 
on the space of (Bcc, 8') strings is equivalent to finding a complex antilinear map from 
{8cc,8') strings to {8',8cc) strings. 

Let us start by assuming that our A-model is a twisted version of a physically sensible, 
unitary, supersymmetric field theory. In general, any such field theory has an antilinear 
CPT symmetry, which we will denote G. For any pair 81,82, the transformation G maps 
{81,82) strings to (^2,-61) strings. This gives an antilinear map from {8cc,8') strings to 
{8',8cc) strings, but it cannot be the map we want, because it is not a symmetry of the 
^-model. The definition of the ^-model depends on a choice of a differential Q, which 
is a complex linear combination of the supercharges. CPT maps Q to (its hermitian 
adjoint), which is the diff'erential of a complex conjugate ^- model. 

To get a symmetry of the ^-model, we need to combine G with a transformation that 
maps the conjugate ^-model back to the original ^-model. We get such a transformation 
if Y admits an involution r (that is a diffeomorphism obeying t'^ — 1) with the property 
that uk is odd under r: 

t*u;k = -COK. (2.17) 

This property implies that r maps the ^-model to the conjugate ^-model. In fact, we 
can always pick a r-invariant metric g, such that ujk is of type (1,1). Then the almost 
complex structure K = g~^u>K is odd under r. So r maps pseudoholomorphic curves to 
pseudo-antiholomorphic curves, and thus maps the ^-model to the conjugate ^-model. 

So Gr = tG is an antilinear map from the A-model to itself. This is a general 
statement about the A-model and holds whether or not the A-model can be obtained by 
twisting an underlying physical theory. (The latter is possible if one can choose K to be 
integrable.) 

Now if 8\ and 82 are r-invariant A-branes, we can use G^- to define a hermitian inner 
product on the space Ti of {81,82) strings. If ( , ) is the pairing between {81,82) strings 
and {82,81) strings given by the two-point function on the disc, then the inner product 
on Ti. is given by 

(V',V') = (0rV',V'')- (2.18) 
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Now let us apply this to our problem. For the brane Bcc to be r-invariant, we first of all 
need that the curvature ujj of the Chan-Paton bundle of this brane should be r-invariant: 

T*u;j = UJJ. (2.19) 

We also actually need a little more: the action of r on M should lift to an action on the 
Chan-Paton line bundle £, whose curvature is uj, and we must pick such a lift. Since ujk 
is odd under r while uj is even, it follows that r is antiholomorphic from the point of view 
of the complex structure / = uj^^ujk'- 

T*I = -I. (2.20) 

It follows from this that each component of the fixed point set of r is middle-dimensional. 
With Q = ujj + iuiKi we also have 

T*n = Vt. (2.21) 

So more briefly, we can summarize the above conditions by saying that r is an antiholo- 
morphic involution of the complex symplectic manifold deflned by the data (F, /, il), with 
a lift to C. 

For the Lagrangian ^-brane B' to be r-invariant, its support M (and its Chan-Paton 
line bundle C) must be r-invariant, and again, we need a lift of r to act on C . In this 
case, we get, finally, a hermitian form on the space Ti, of {Bcc-, B') strings. Note that r need 
not leave M fixed pointwise, but it must map M to itself. If r acts trivially on M, the lift 
to if it exists, can be uniquely specified by saying that r acts trivially on the restriction 
of C to M. If r acts nontrivially on M, its lift to C may involve a subtle choice. 

The hermitian inner product ( , ) is not necessarily positive definite (which means as 
usual that {i^ji^) > for all nonzero '0 G ?i), but it is always nondegenerate. Nondegen- 
eracy means that given -i/^ G 7Y, there is always x G such that (x, t/^) ^ 0. This follows 
from nondegeneracy of the underlying topological inner product ( , ) and the fact that 
0^ = 1. Picking xo such that (xo, V') 7^ cind setting x = ©rXo, we have (x, V') 7^ 0- 

Near the classical limit, the norm of a state '0 G 7i is roughly {ijj, ifj) = Jj^^ i/){tx)'iI^{x). 
Such a form can be positive-definite only if r acts trivially on M. So for ( , ) to be 
positive near the classical limit, we require that r should act trivially on M. Since M 
(being Lagrangian) is middle-dimensional, while the fixed point set of the antiholomorphic 
involution r is also middle-dimensional, this means that M, assuming it is connected, is a 
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component of the fixed point set. (In section 3.8, we give an example far from the classical 
limit in which ( , ) is positive even though r acts nontrivially on M.) 

Conversely, if M is a component of the fixed point set of r, then, as ujk is odd under 
T, M is automatically Lagrangian for ujk- Moreover, uj is automatically nondegenerate 
when restricted to M. (To prove this, start with the fact that, if M is held fixed by 
an antiholomorphic involution r, then the restriction to M of the tangent bundle to Y 
decomposes as TY\m = TM © I(TM). r acts as 1 and —1 on the two summands, and, 
being r-invariant, ujj is the sum of a nondegenerate two-form on TM and one on I{TM).) 

Thus, the case of our construction that leads to unitarity near the classical limit is 
much more specific. Introducing the space of {Bcc, ^cc) strings, we carry out deformation 
quantization of the complex symplectic manifold Y , constructing an associative algebra A. 
Then, to get a Hilbert space Ti. on which A acts, we pick an antiholomorphic involution r 
(with a lift to the line bundle C ^Y) and a component M of the fixed point set supporting 
a T-invariant ^-brane B' . H is defined as the space of {Bcc,B') strings, and A acts on H. 

The operation 0,- acts on a function / on Y, defining a {Bcc,Bcc) string, as the 
composition of r with complex conjugation. So if C/ : H ^ H is the operator associated 
to /, then the hermitian adjoint of Of is associated with the function t(/). In particular, 
if T leaves M fixed pointwise and / is real when restricted to M , then t(/) = / and Of is 
hermitian. 



3. Branes And Representations 

3.1. An Example 

To make these ideas more concrete, we will consider in more depth an example that 
was introduced in section 1.2. This is the case that Y is an affine algebraic variety defined 
by the equation x'^ + y"^ + z"^ = jJ?' j^: in complex variables j/, z. Here ji^ is a complex 
constant. Y admits the action of a group 5'0(3,C), rotating j/, and z. In quantization, 
we will encounter the double cover of 50 (3, C), which is S'L(2,C). 

We make Y a complex symplectic manifold by introducing the holomorphic two-form 

n = h-'^-^^ (3.1) 

X 

where h is another complex constant, h could be eliminated (at the cost of changing jj) 
by rescaling a;, j/, and z, and we will eventually set h = l. 
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Q is 50(3, C)-invariant. One way to show this is to observe that Y is defined by 
the equation / = in C^, where f = x"^ + y'^ + z'^ — jJ?' /A. The meromorphic differential 
2h~^ dx Ady A dz/ f is manifestly SO{S, C)-invariant, with a pole precisely at / = 0. The 
residue of this pole is fl. 

Consequently, the ^- model of Y with symplectic structure ujy = Imfi has <S'0(3, C) 
symmetry. If we consider only the usual Lagrangian A-branes, we do not get much from 
the SO{3, C) action. That action becomes interesting, however, if we introduce coisotropic 
A-branes. 

As a preliminary, we compute the cohomology class of Q. We set x = 
y = y^/Ji?/2, z = z^/Jj?/2. The two-dimensional homology of Y is generated by the real 
two-cycle S defined hy x^ + y"^ + z^ — 1. We compute that 

y^-=ft-v. (3.2) 

where /i = ±-\//i^. The sign depends on the orientation of S. 

Hence the cohomology class of ReO/27r is integral if n = Jic{h~^fi) is an integer. 
Under this condition, we can construct a iniitary line bundle C with a connection of 
curvature Re Q. This determines a space-filling coisotropic brane Bcc in the A-model with 
symplectic structure cuy = Imfi. The first Chern class of C, integrated over S, is equal to 
n: 

f ci(£) = n. (3.3) 
Js 

Now let us describe the ring A of {Bcc, Bcc) strings. Classically, as explained in 
section 1.2, it is the commutative ring of polynomial functions in x,y, and z, modulo the 
commutativity relation 

[x,y] = [y,z] = [z,x]^0 (3.4) 

and the geometrical relation 

x^ + y'^ + z'^= f?/4:. (3.5) 

In the context of the coisotropic brane, we have to consider possible corrections to those 
relations. Corrections involve the Poisson brackets, which are proportional to = 
hz{dx A dy)~^, and higher order terms involving higher powers of and its derivatives. 

It is simple to determine the corrections to the classical relations, because they are 
severely constrained by (i) S0{3,C) symmetry, (ii) holomorphy, and (iii) an approximate 
scaling symmetry. Of these points, 50(3, C) symmetry requires little explanation. By 
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holomorphy, we mean holomorphy in h and n'^ near h = = 0. Holomorphy in h is 
manifest in sigma-model perturbation theory. At = 0, Y develops a singularity at the 
origin, but the ring A is nevertheless holomorphic in /x^ since the corrections to the classical 
ring structure can be computed in a region of field space far away from the singularity of 
Y. Finally, if /s^ = 0, then Y has a scaling symmetry (x, y, z) {tx, ty, tz), t E C* . 

For 7^ 0, this is only an asymptotic symmetry, valid for (x, y, z) — oo. Even if 
/i^ = 0, the algebra A does not have the scaling symmetry, because Q does not possess this 
symmetry. Still, the scaling symmetry heavily constrains the corrections to the classical 
algebra generated by x, y, and z. Under the scaling symmetry, we have fx'^ ^^A*^, h — > th. 
The crucial point is that /x^ and h both scale with positive powers of t. 

The most general deformation of ( |3.4| ) that is allowed by holomorphy and 5*0(3, C) 
symmetry is [x,y] = f{n'^,h)z (and cyclic permutations) for some function /. Under 
scaling, / must be of degree 1, and holomorphy then implies that it is linear in h and 
independent of /x^. But the term linear in h can be computed simply from the classical 
Poisson bracket, giving [x,y] = hz, and cyclic permutations. 

As for the relation ( p.5|) , holomorphy, SO{3,C) symmetry, and scaling symmetry 
dictate that /i-dependent corrections can only take the form of a constant multiple of h'^. 
Thus the relation must take the form x"^ +y'^ + z'^ = /U^/4 + c/i^, for some complex constant 
c. This constant can be computed by going to second order in sigma-model perturbation 
theory, but instead we will use an indirect method to show in section 3.2 that c = —1/4. 

Because of the scaling symmetry, we lose nothing if we set h = 1. The form of the 
algebra is then that x, y, and z obey the SO{3, C) commutation relations 

[x:y]=z, [y,z]=x, [z,x]=y, (3.6) 

and that the quadratic Casimir operator = + + z'^ is 

j2 = (3.7) 
4 

For an alternative way to compute this algebra, from a different starting point, see ||25|| . 

The preceding statements imply that if B' is any A-brane, then the space of (i3cc, B') 
strings has a natural action of the Lie algebra so(3,C) or s[(2, C) (generated by x,y,z). 
The value of the quadratic Casimir is {(j? — l)/4, independent of the choice of B' . We will 
see examples below; with different choices of B' , we will get different s [( 2, C) -modules, all 
with the same value of the quadratic Casimir. 
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To get a natural group action (as opposed to an action of the Lie algebra) requires 
more. The reason for this is that if G is a noncompact group, then a representation of the 
Lie algebra Q oi G does not automatically exponentiate to an action of G. The brane Bcc 
is SL{2, C)-invariant, since its Chan-Paton curvature Refi is invariant under SL{2, C). A 
Lagrangian A-brane B' will not be SL{2, C)-invariant. If B' is invariant under a subgroup 
G of SL{2, C), then G acts naturally on the space of {Bcc, B') strings. We use this starting 
in sections 3.2 and 3.3 to construct representations of SU{2) and SL{2,'R). 

Actually, something less than G-invariance of B' suffices to get an action of G on the 
space of {Bcc, B') strings. What we need is only that, for all g E G, the brane {B')^ obtained 
by transforming B' by g should be equivalent to B' in the A-model. Hamiltonian isotopies 
of Y with compact support, and more generally those that rapidly approach the identity 
at infinity, act trivially in the A-model. So if the h action on B' can be compensated 
by a Hamiltonian isotopy that has compact support, or that approaches the identity fast 
enough at infinity, then {B')^ is equivalent to B' as an ^-brane. If this holds for all g E G, 
then G acts on the space of {Bcc, strings. For examples, see sections 3.7-8. 

The functions x^y, and z transform in the adjoint representation of 5'0(3,C). The 
polynomial functions in y, and z modulo the commutation relations generate the uni- 
versal enveloping algebra U of 50(3, C). The ring ^ is a quotient U/I, where I is the 
ideal generated by x^ + y^ + z^ - {fi^ - l)/4. 

Now let us discuss hermitian structures. As explained in section 2.4, to get a hermitian 
structure from branes, we need an antiholomorphic involution r :Y ^ Y that maps Q to 
Q. There are essentially two choices. The obvious choice 



has all the necessary properties and breaks S0{3,C) to the compact subgroup SO {3). 
Quantization of a r-invariant brane will therefore lead to unitary representations of SO {3), 
or its double cover SU{2). The alternative, up to a change of coordinates, is 



This breaks SO{3,C) to 50(1,2), whose double cover is SL{2,'R). Quantization of r- 
invariant branes will lead to unitary representations of SL{2,'R). 

Parameters Of The A- Model 



T : {x,y,z) {x,y,z) 



(3.8) 



T : {x,y,z) {-x,-y,z). 



(3.9) 
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A nice property of this model is that Y actually admits a hyper-Kahler metric, extend- 
ing the complex symplectic structure In fact, with such a hyper-Kahler structure, 
Y is known as the Eguchi-Hansen manifold. We write /, J, K for the three complex struc- 
tures and u}j,ujj,ljJk for the corresponding Kahler forms. The hyper-Kahler metric on Y 
is completely determined by the three periods 

27r 



UK 

where a, 13, 7 are arbitrary real parameters. These parameters are uniquely determined up 
to an overall sign (a, /3, 7) (— ct, — /3, —7), which is equivalent to a reversal of orientation 
oiS. 

The holomorphic two-form in complex structure I is Q. = uj -\- iuk, so looking back 



to (|3.2|) , we see that the parameters are related by 

^ = l3 + i'y. (3.11) 



(As before, n = ±a//U^; the sign depends on the orientation of 5", which also affects the 
sign of (3 and 7.) 

At the fixed point a = f3 = 'j = 0,Y develops an Ai singularity. In fact, according to 
( p.ll|) , at ct = /3 = 7 = 0, the equation for Y reduces to + + z'^ = 0, with a singularity 
at the origin. From the point of view of complex structure /, turning on a resolves the 
singularity, and turning on f3 + i'y deforms it. 

The supersymmetric sigma-model with target Y has a fourth parameter, a mode of 
the sigma-model S-field. This parameter is 

V = [ ^ (3.12) 

JS ^TT 

and takes values in M/Z. A sign change of a,/3,7 must be accompanied by a sign change 
of 77, since it involves a reversal of orientation of S. The symmetry is therefore 

(a,/3,7,r7) ^ (-a, -7, -?7). (3.13) 

The parameter space of the mo del is therefore W = (M^ x S^)/Z2. 
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The present paper is really based on the A-model for symplectic structure ljk- This A- 
model is independent of a and jS (which control complex structure K rather than symplectic 
structure uk) and depends holomorphically on 



X = r] + i'y. (3.14) 



Indeed, 7 is a period of ujk, according to eqn. ( p.lO| ). As usual, the A-model parameters 
are obtained by complexifying the periods of the symplectic form to include S-field periods. 

Though the A-model is independent of a and /3, some A-branes are conveniently 
defined and studied for favorable values of those parameters. A case in point is the problem 
of defining a space-filling A-brane Bcc of rank 1. The Chan-Paton bundle of such a brane 
has a curvature two-form F such that {uj^^{F + B))'^ = —1. (In discussing this equation 
in section 2.1, we assumed that B = 0.) A convenient way to solve this equation is to pick 
a and /3, so as to determine a hyper-Kahler metric, and then require that 

F + B = uj. (3.15) 

Dividing by 2n and integrating over S, this implies that 

/ ciiC)+r^ = /3. (3.16) 
Js 

Thus, to define a coisotropic brane in this way, we must pick (3 so that /3 — 77 is equal to the 
integer n = JgCi{C), which was already introduced in eqn. (|3.3|). For any given A-model 
parameter 77, this construction can be made for any n, with /3 adjusted accordingly. So the 
same A-model has a family of coisotropic branes depending on the integer n, though it is 
hard to use a single hyper-Kahler metric to construct all of them. 

Comparing ( |3.16| ) with ( |3.11[ ) and ( |3.14| ) , we see that for a convenient choice of hyper- 



Kahler metric, the geometrical parameter fj,'^ is related to the A-model parameter A by 

fi = X + n. (3.17) 

In most of our discussion, we will set r] = 0, and we will pick a particular coisotropic brane 
with n fixed. This means that we set (3 = n. 

Now let us determine how the involutions r and r, which are antiholomorphic in 
complex structure /, act on the parameters. Of course, neither r nor r is a symmetry 
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unless fx'^ is real. Thus, either 7 = and fx^ = (3'^ is non-negative, or /3 = and fx'^ = —7^ 
is non-positive. 

In general, an antiholomorphic symmetry in complex structure / reverses the sign of 
the Kahler form ivj. Also, r and r map Q = ivj + iivx to O, so they leave fixed uj and 
reverse the sign of lok- To be symmetries of the sigma- model, r and r (which are not 
supposed to be orientifold symmetries; they should preserve the orientation of a string 
worldsheet) must preserve the S-field. The action of r or r on the parameters (a, /3, 7, ry) 
is therefore 



(The sign depends on whether r or r preserve the orientation of which as we see later 
can depend on the values of the parameters.) Thus, if /3 7^ 0, we may have r] ^ without 
spoiling r or r symmetry, but we must set a = 7 = 0. And if 7 7^ 0, we may have a 7^ 0, 
but we must set (3 — rj — 0. 

3.2. Representations Of SU{2) 

We begin by considering unitary representations. To extract from the A-model a 
space of strings with a Hilbert space structure, we need to pick a second A-brane B' that 
is supported at the fixed point set of r or r. 

We first consider the case of a brane B' supported at the fixed point set of r. This 
fixed point set, which we will call M, consists of real x, y, z, obeying x'^ + y'^ + z"^ = 
In particular, = {(3 + i'-yY must be real and positive (or M is empty or collapses to a 
point, which is not a Lagrangian submanifold) , so /3 7^ 0, 7 = 0. M is S't/(2)-invariant, so 
quantization of {Bcc,B') strings will lead to unitary representations of SU{2). 

A Lagrangian brane supported on M exists only if ry = 0. Indeed, if F' denotes the 
curvature of the Chan-Paton bundle of B' , then the Lagrangian condition is {F' +B)\m = 0. 
Given (|3.12|) (and the fact that M coincides with S in this example), this implies that 
B /2ti = Q mod Z, or 77 = 0. Since also 7 = 0, ( p.l7| ) tells us that 



(a, 13, 7, 77) -> ±(-a, -7, T]). 



(3.18) 



// = n. 



(3.19) 



where 




(3.20) 



As usual C is the Chan-Paton bundle of B, 
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As M is simply-connected, the Chan-Paton bundle of B' is trivial, so the space of 
{Bcc,B') strings is related to quantization of M with prequantum line bundle C\m- 

An interpretation via quantization only exists if wj is nondegenerate when restricted 
to M. This implies that n must be nonzero. We may as well orient M so that n > 0. 

Quantization of M with n units of flux gives a Hilbert space 7i of dimension n, 
furnishing an irreducible representation of SU{2) with j = [n — l)/2. The quadratic 
Casimir operator = j{j + 1) thus equals (n^ — l)/4. Since = iJ? according to eqn. 
( pi.l9| ), this is equivalent to = {iJ? — l)/4. This result agrees with (|3.7|), and accounts 
for the choice of constant in this formula. 

The generators J^;, Jy, and of SU{2) arise by quantizing the functions x, y, and 
z. We diagonalize J2, flnding a basis of eigenstates of J^, each obeying Jz^fps = for 
some s. According to a standard analysis, in an n-dimensional irreducible representation 
of SU{2), the values of s are 

-^,1-^,2-^,...,^. (3.21) 



The range of eigenvalues of Jz is in accord with the classical fact that on the brane char- 
acterized by x"^ + y'^ + z'^ = n^/4 (with real x,y,z) z is bounded by — n/2 < z < n/2. 
Because of quantum mechanical fluctuations, the maximal value of \Jz\ in the quantum 
theory (namely {n — l)/2) is slightly less than the classical upper bound n/2. 

3.3. Discrete Series Of SL{2,R) 

To construct unitary representations of SL(2, M), we proceed in a similar way, but now 
we consider r-invariant branes. It is convenient to make a change of coordinates x ^ ix, 
y ^ iy, so that the equation deflning Y becomes 

-x'-y' + z'^^, (3.22) 

and T acts simply by 

{x,y,z) ^ {x,y,z). (3.23) 

We continue to assume that 77 = 0, and to ensure that Y admits the symmetry ( |3.23|) , 
we take real. We begin with the case > 0, which means that 7 = 0, /3 7^ 0. Just as 
in the last subsection, existence of the brane Bcc requires us to take (3 to be an integer. 
This integer is n = ci{C), where now C y is given by imaginary x and y and real z. 
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As in section 3.2, we may as well take n > 0. However, in section 3.2, we required n > 
to ensure that coj remains nondegenerate when restricted to S. For our present purposes, 
this is irrelevant (we will not consider a brane wrapped on S), so we allow n = 0. For 
n = 0, the equation defining Y reduces to —x^ — -\- =0, with an Ai singularity at 
2; = y = 2; = 0, sowe should expect that some unusual behavior may occur at that point. 

The fixed point set of r consists of real y, z. The equation = jJ?' /A + x'^ + y'^ 
shows that this fixed point set has two components M±, given by 

z = ±Va*V4 + x2 +1/2. (3.24) 



Each component is equivalent to the complex upper half-plane with the usual action of 
S'L(2,R). In particular, the components M± are simply-connected, and each supports a 
unique rank 1 ^-brane B'^. 

We quantize M± by taking the space of (Sec, B'^) strings. This should give a unitary 
representation of 5'L(2, R) with the same value of the quadratic Casimir that we found 
in section 3.2, namely = (n^ — l)/4. (The value of the quadratic Casimir must be the 
same because it is determined entirely by the choice of the space Y and the brane Bcc, 
independent of the choice of a second ^-brane B'.) On the classical phase space M±, the 
range of values of 2; is n/2 < 2 < oo on M_|_ and —00 < z < —n/2 on M_. Hence in the 
representation D+, should be unbounded above, but bounded below by approximately 
n/2; and in the representation D~ , should be unbounded below, but bounded above by 
approximately —n/2. 

Unitary representations of 5'L(2,]R) with these properties do exist and are known as 
the discrete series. The precise set of values of Jg is 

1 + ^, 2 + !^,... (3.25) 



for and 



n 



-1-^—, -2-^—,... (3.26) 



2 ' 2 ' 2 

for D~. We will explain these formulas in section 3.5 after describing the principal series. 
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34- Principal Series Of SL{2,R) 

Now we consider the case /x^ < 0, that is /3 = 0, 7 0. The fixed point set M of r is 
now given by the equation 

x^ + y^=^ + z^ (3.27) 

with x,y, and z real. It is connected, with the topology of R x S'-'^ (for 7 7^ 0). z 
is unbounded above and below, so in a representation obtained by quantizing M, Jg is 
similarly unbounded. 

The first Betti number of M is 1, so there is a one-parameter family Bg of rank 1 A- 
branes supported on M; roughly speaking, the monodromy of the Chan-Paton bundle of 
Bg around the circle in M is exp(27rz5). To be more precise, we recall that the Chan-Paton 
bundle of an A-brane is actually a flat Spin^ bundle (not a flat line bundle), so we actually 
need to pick a spin structure in order to define 5 as a number. To define S precisely, we 
declare that 5 = corresponds to the Ramond spin structure (the one that corresponds to 
a trivial real line bundle over a circle). 

Topologically, R x 5^ is the same as the cotangent bundle T*S^. We explain below 
how to make contact between the present problem and quantization of M = T*S^ with 
its standard symplectic structure. For now, we just proceed informally. In quantizing 
M = T*S^ via functions (actually half-densities) on. S^, a wavefunction picks up a phase 
exp(27rz5) in going around . As a result, the eigenvectors of are exponentials cxp(z(?i-|- 
5)6), where 6 is an angular variable on 5"^, and n is any integer. The spectrum of Jz is 
thus of the form {5 -\-n\n G Z}, and is unbounded above and below, as expected. 

To get a representation of 5'L(2,M), the eigenvalues of Jz must be integers or half- 
integers, and so 5 must be or 1/2. For generic 5, we get a representation not of 5'L(2,M), 
but of its universal cover, which we denote <S'L(2,M). 

The representations obtained from this construction are known as the principal series 
representations P-y^s- These are representations of /S'L(2,R) (or its universal cover) with 
quadratic Casimir 

J' = (3.28) 

for real 7. The spectrum of Jz is {S + n\n e Z}, as we described above, and we get a 
representation of S'L(2,R) (as opposed to a cover) precisely if 5 = or 1/2. The central 
element diag(— 1, —1) of 5'L(2,R), which corresponds to a 27r rotation of the circle, acts 
by exp(27rz5). 
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A standard algebraic analysis (which we will essentially explain in section 3.5) shows 
that P^^s is irreducible unless 7 = and 5 = 1/2. In that case, one gets 




(3.29) 



where Dq is the n = case of the discrete series representations of subsection 3.3. Let 
us try to understand this decomposition from the present point of view. 

If we set 7 = 0, M reduces to the cone z'^ = x'^ + y'^. It is a union of two components 
with z > and z < 0, respectively. These are the specialization to n = of the two 
symplectic manifolds M_(_ and M_ whose quantization led to the discrete series. Topolog- 
ically, each of M_|_ and M_ is a disc, with a unique flat Spin^ structure that actually is a 
spin structure (since M± are simply-connected). On a circle at infinity, this spin structure 
corresponds to the bounding or Neveu-Schwarz spin structure, which we get at 6 = 1/2. 
So it is only at 5 = 1/2 that a brane supported on M decomposes (when we set 7 to zero) 
as the sum of a brane supported on M_|_ and one supported on M_ . At any other value of 
5, M_(_ and M_ are linked by a monodromy at the origin. 

The Singularity ^4^ 7 = 

At 7 = 0, y is described by + — 2;^ = 0, with an Ai singularity at the origin. 
To understand better this case, we exploit the fact that the parameter a is trivial in the 
A-model. We can turn on a and remove the singularity without changing the A-model. 
Moreover, since we here have /3 = 0, this does not disturb r symmetry. 

Turning on a has the effect of blowing up the singularity. A convenient way to describe 
the blowup is as follows. Consider a space C"^, with coordinates (a, b,p), subject to a scaling 
symmetry (a, b,p) {ta, tb, t~'^p), t G C*. The ring of C*-invariant functions is generated 



y = abp, 

subject to one relation x'^ + y"^ — z'^ = 0. Let Z be the locus in C'^ consisting of points in 
which a and b are not both zero. The quotient Y' = Z/C* has a natural map to Y, given 
by ( |3.30| ). This map is one-to-one except that the inverse image of the origin in y is a 
copy of CP^ given by p = 0. Thus, Y' is obtained (in complex structure /) by blowing up 
the singularity of Y at the origin. The holomorphic two- form of Y' , which corresponds to 
O under the above map, is Vt' = {adb — b da) A dp — 2p da A db. 



by 



X — z 



X + z 




(3.30) 
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The Lagrangian submanifold M' that corresponds to M is defined by taking a, b, p real. 
To describe M' exphcitly, we use the scahng symmetry to set + b"^ = 1. This leaves a 
freedom of reversing the sign of a and b, so we set a = cos(^/2), b = sin(^/2) for some angle 
6. The symplectic structure with which we need to quantize M' is ujj = Refl' = dp A dd. 
This is the standard symplectic structure of T*S^. Moreover, the action of S'L(2, R) 
on T*S^ is the natural action coming from the usual action of /S'L(2, M) on = MF^. 
Quantization leads to half-densities on S^, with the natural action of SL{2,R) on the 
space of half-densities. If we take 5 7^ 0, wc get half-densities twisted by a flat bundle 
of monodromy exp{2niS). This leads to the spectrum of described above. (In this 
description, the reducibility of the SL{2,M.) representation at 5 = 1/2 is not clear.) 

When 7 7^ 0, M is smooth and the blowup via a is not necessary. In this case, by 
setting (x^y^z) = i7(coshpcos^, coshpsin^, sinhp), we can identify M with T*S^ with 
its usual symplectic structure. This identification commutes with the group of rotations 
of the circle, so it can be used to determine the spectrum of Jz, but it does not com- 
mute with SL{2,M.), so it does not directly determine the SL{2,M.) representation. It 
can be shown that the representation Py^s can be interpreted as the space of densities of 
weight 1/2 + ^7 twisted by a fiat line bundle with monodromy exp(27ri5), with the natural 
action of SL{2, M) on this space. One way to show this is to use the fact that M has 
an S'L ( 2, M) -invariant map to with Lagrangian fibers; in other words, M admits an 
S'L (2, M) -invariant real polarization. (In fact, M has two such polarizations.) 

3.5. Algebraic Description 

To better understand some things that we have already encountered and in preparation 
for what follows, we will summarize some standard facts about representations of sl{2) from 
an algebraic point of view. 

In our construction, quantization of the functions x, y, and z gives operators J^, Jy, Jz 
that obey the usual s((2) commutation relations such as [Jx, Jy] = iJz- As usual, it is 
convenient to set J± = iJy For unitary representations of su(2), is hermitian and 
J+ is the hermitian adjoint of J_. For unitary representations of £l(2, M), is hermitian 
and J+ is minus the adjoint of J_. We summarize the facts about J±: 



We will consider both unitary representations and representations that are not required 
to be unitary. In the unitary case, since is hermitian, it can be diagonalized with 




for su(2) 
for sl(2,M). 



(3.31) 
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real eigenvalues, but in any event, we only consider representations in which Jz can be 
diagonalized. We also assume that the quadratic Casimir operator can be diagonalized, 
and we often write simply for its eigenvalue. 

Suppose that is an eigenvector of J^, with J^i^ = sifj for some s. Additional 
eigenvectors can be constructed by acting with J_|_ or J_. This process may continue 
indefinitely in both directions, giving a representation in which (or more exactly the 
real part of its eigenvalue) is unbounded above and below. Alternatively, it may terminate 
in either or both directions, if we find a highest weight vector obeying 

J.^A - s+i/j, J+tl; - 0, (3.32) 

or a lowest weight vector i(; obeying 

Jz^ = S-V', = 0. (3.33) 

In an irreducible representation, the quadratic Casimir operator = + Jy + J| is 
a multiple of the identity. It can be written 



(3.34) 



— — J z ''f J+J—- 

If ( p.32|) is obeyed, we use the first formula in (|3.34| ) to deduce that 

J2 = s+(s+ + l), (3.35) 

and if ( |3.33| ) is obeyed, we use the second formula to deduce that 

J2 = s_(s_-1). (3.36) 

If ( ^.35| ) is obeyed for some value of s_|_, then ( |3.36D is obeyed with 

s-=s+ + 1. (3.37) 

Thus, it is possible to have a representation of highest weight if and only if it is possible 
for the same value of the quadratic Casimir to have a representation of lowest weight + 
This explains the relation between the bounds on for finite-dimensional representations 
in ( p.21|) and the corresponding bounds for discrete series representations in ( |3.25| ) and 

(ill)- 
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If we assume unitarity, we can learn a little more. A vector i/j obeying J^ip = s+tl^, 
where s+ obeys ( p.35| ), must be annihilated by J+. Indeed, we have J-J+ij; = (J^ — J| — 
Jz)"^ = 0. So = (-0, J-J^ifj). In the unitary case, the right hand side is ±(J_|_'0, J+i/^), 
and its vanishing implies that J_|_'0 = 0. Similarly, if J^^-i/^ = S-%/j, and s_ obeys ( |3.36|) , 
then in the unitary case, it follows that J-i/j = 0. 

If -0 is a highest weight vector with Jzi^ = s+t/j, then > for a unitary represen- 
tation of su(2), and < for a unitary representation of s[(2,]R). The two statements 
can be combined to es-(- > 0, where e = 1 for su(2) and e = — 1 for s[(2, R). To see this, we 
note that J+ifj = implies that 2s+('i/', ■i/') = (i/j, 2 J^i/j) = (?/', [J_|_, J-]?/') = {i/;, J+J-ifj) = 
e{J-ilj, J-ifj), where ( p.31|) was used in the last step. This indeed implies that es_|_ > 0, 
with equality only if J-i(; = 0, which implies that i/j generates a one-dimensional trivial 
representation. A similar argument shows that a lowest weight vector has s_ < in the 
case of a unitary representation of 5u(2), and s_ > in the case of a unitary representation 
of s[(2,M). 

A standard fact, which we will not review here, is that every irreducible representation 
of SU{2) has both a highest weight vector and a lowest weight vector Moreover, we 
can assume that "0 = J"?/' for some integer n. If J^i/^ = sj^ij}, then Jzif} = {sj^ — ?t.)'0. The 
quadratic Casimir is = -|- 1) = — — n — 1), implying that = n/2 is 

an integer or a half-integer. 

For the case of a non-trivial irreducible unitary representation of 5t(2, M), it is impos- 
sible to have both a lowest weight vector and a highest weight vector. The Jz eigenvalues 
would have to be negative for the highest weight vector, and positive for the lowest weight 
vector; but a highest weight vector has a higher weight than any other vector in an irre- 
ducible representation. This being so, we cannot make an argument like the one in the 
last paragraph, and there is no way to show algebraically that the eigenvalues of Jz take 
values in Z/2. When the eigenvalues are valued in Z/2, we get a representation of the 
group SL{2, M), while the more general case leads to representations of its universal cover. 
In sections 3.3-4, we have encountered unitary representations of S'L(2,R) with neither a 
highest weight vector nor a lowest weight vector (the principal series), as well as unitary 
representations with a lowest weight vector (the discrete series D^) or a highest weight 
vector {D~). 



Relaxing Unitarity 
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Now let us consider representations that are not necessarily unitary. The quadratic 
Casimir can act as a complex number, which we simply call J^, and likewise the eigenvalues 
of Jz can be complex. Consider a representation that contains a vector with J^ip = sip 
for some s. If s and are generic, then there does not exist an integer n such that is 
equal to (s + n)(s + n + 1). In this case, none of the states J^V J!"V' have eigenvalues 
obeying (|3.35|) or ( |3.36| ), so these states are all nonzero. So a representation with generic 
s and is infinite in both directions, like the principal series representations. 

For special values of s and J^, something special can happen. If = s(s + 1), it 
is possible to have a representation R~ spanned by vectors 'i/'^, n = 0, —1, —2, . . ., with 
Jz^^l^n = (s + n)il)n- This representation has a highest weight vector i/'o with Jz'fpo = sipQ. 
It is also possible to have a representation spanned by vectors i/'^, n = 1,2,3..., 
again with Jzipn = (s + n)ipri- This representation has a lowest weight vector ipi with 

Jztpi = (s + 

Now let us consider a general representation R spanned by vectors ipm n E obeying 
Jz'Pn = {s + n)'ipri- Suppose that J-^-ipn = OnV'n+i, J-'Pn+i = bnipri, for some complex 
constants ttmbn- Again, write for the eigenvalue of the quadratic Casimir operator. 
Using (|3.34|) , we deduce that for all n. 



anbn = J'^ - {s + n){s + n + l). (3.38) 

This is a necessary and sufficient condition to get a representation of the Lie algebra sl(2, C) 
with the assumed value of the Casimir. For every n, we are free to redefine tpn —>■ Xnipn, 
for A„ G C*, along with 

O-n ^n^n+l^rn bn Xn+lX^^^bn- (3.39) 

As long as and s are such that — (s + n)(s + n + 1) never vanishes, and bn are 
nonzero and are uniquely determined, modulo a transformation of the type ( p.39|) , by the 
equations ( p.38|) . This gives an irreducible representation for the assumed values of and 
s, generalizing the principal series. 

Suppose on the other hand that J'^ — {s + n){s + n + l) = for some value of n. Then 
we have a^fe^ = 0, leaving three choices: 

(1) We may have an = bn = 0. This gives a representation R that decomposes as a 
direct sum R = Ri Q) R2, where Ri has a highest weight vector ipn and R2 has a lowest 
weight vector ipn+i- 
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(2) We may have bn = 0, 7^ 0. This gives a representation R that contains a 
subrepresentation R2 spanned by vectors -i/'m,, m > n + 1. R2 has a lowest weight vector 
i^n+i- There is no complementary representation but rather R can be described as an 
extension: 

R2^ R^ Ri^Q. (3.40) 

Here Ri is spanned by i/^rn, m < n, but is not a subrepresentation of R, since 7^ 
and V'n is not a highest weight vector. However, Ri can be understood as a quotient 
representation R/R2- 

(3) Finally, we may have = 0, 6„ 7^ 0. This gives an extension in the opposite 
direction: 

0^ Ri-^ R^ R2^0. (3.41) 

Here Ri is the subrepresentation spanned by i(jm, m < n, and containing the highest weight 
vector ijjn- R2 is the quotient representation R/Ri. 

The phenomenon just described involving non-split extensions does not occur for 
representations of either real form of st(2) that admit a nondegenerate hermitian form, 
since in that case bn = ia^ in view of ( |3.31| ). What nonsplit extensions mean in terms of 
branes will be described in section 3.7. 

If we further specialize s and J^, the equation J"^ = {s + n){s + n + 1) may have two 
integer solutions, say ni and n2. In this case, we run into the two equations an^bn^ = 
and 0^2^712 = 0, and we can independently choose, in each of the two cases, which if either 
of a and b is nonzero. 

Hermitian Structure 

Now let us specialize this to the case of a representation of s[(2, M) compatible 
with a hermitian structure ( , ). The relations J+V'n = dni^n+i, J-i^n+i = bni^n im- 
ply {tpn+l.J+tpn) = an{tpn+l,'^n+l), {tpn, J-i^n+l) = 6n(V'n,^n)- If J- = -J+, then 

(i/;^, J-i/jn+i) is minus the complex conjugate of (V'n+i, J+i^n), so we get 

|(^n+l,^+V^n)P .^x 

anbn = -7- -, rr-, (3.42) 

For a unitary representation, (•0„, i/^n) > for all n. In this case, ( p.42| ) implies 
that ttnbn < (unless i/'n is a highest weight vector). Let us apply this to a unitary 
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representation in which the set of eigenvalues is {s + n\n G Z} for some real s. Together 
with the fact that a^6^ < 0, ( p.38| ) implies that {s + n){s + n + 1) > for all n, or 

(s + n + 1/2)2 > J2 + 1/4. ^3 43) 

For example, let us consider representations of 5'L(2,R) in which s = so that the central 
element diag(— 1, —1) acts trivially. The condition that {n+1/2)'^ > J'^ + 1/4 for all integers 
n is equivalent to < 0. We have already encountered the relevant unitary representations 
with J2 < —1/4. These are the principal series representations with = — (7^ + l)/4. 
The unitary representations with > > —1/4 are known as the complementary series. 
Algebraically, the complementary series is simply the analytic continuation of the principal 
series to > —1/4 or imaginary 7. (Eqn. ( p.38|) with the equivalence relation ( |3.39| ) 
give a general description for all and s.) However, natural geometric realizations of the 
hermitian structure undergo a sort of phase transition at = — 1/4. For an explanation of 
how this happens (in a standard description of the representations via densities of suitable 
weight on S^), see chapter 1.3 of |2^]. In terms of branes, we described the principal series 
in section 3.4, and we will describe the complementary series in section 3.8. 

A representation of sl{2, R) with any real and s can admit a nondegenerate hermi- 
tian structure, though not necessarily a positive-definite one. Let us see what happens for 
s = and > —1/4. If there is an integer n such that = n{n + 1), the representation 
has a lowest weight or highest weight vector, as we have seen above. Let us suppose that 
this is not the case. Eqns. (|3.38|) and ( |3.42| ) imply that 

('0n,'0n)(^n+l,^n+l) = {niu + 1) - j'^)\{tpn+l, J+'i/'n)^ • (3.44) 

Let no be the largest integer such that no (no -f 1) — < 0. Then the condition n{n + 
1) — J2 < is obeyed for 2n.o + 2 values of n., namely —no — 1 < n < no- From ( p.44| ), it 
follows that if n is in this range, then ('i/'n+i, i^n+i) and (■(/'„, ^fjn) have opposite signs. The 
total number of sign changes is even, so if {i/^m i^n) is positive for large positive n, then it 
is also positive for large negative n. However, the no + 1 states 'i/'„g_2A;, < /c < no, have 
negative norm. 

A similar analysis can be made for other values of s. For brevity, we consider only 
the question of s = 1/2, which is associated to representations of SL{2,M.) in which the 
central element acts as —1. For s = 1/2, ( p.43| ) tells us that —1/4 > J^, which is the range 
covered by the principal series. So there are no new unitary representations to be had. 
There are, of course, representations with indefinite but nondegenerate hermitian forms. 
For J2 > —1/4 and s = 1/2, the number of sign changes is odd, so if (i/jmi^n) is positive 
for large positive n, it is negative for large negative n. In the region near n = 0, the signs 
alternate. 
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3.6. Discrete Series Of SL{2,R) 

It is now straightforward to complete the description of the discrete series. For a 
unitary representation, = {(3 + i'j)'^ must be real, so either or 7 vanishes. We have 
already considered in section 3.4 the case of /3 = with generic 7. So here we take 7 = 
with generic (3. 

From ( |3.1(j| ), we have P = rj + n, where n = jg ci{C) is an integer and r] is the world- 
sheet theta-angle. Thus, to get generic (3, we must take rj to be nonzero. The quadratic 
Casimir is = — l)/4, just as in the case of integer /3. As in section 3.2, we introduce 
a second A-brane B'^ supported on the locus M± defined hj z = ±a//U^ + + y^. (The 
Chan-Paton bundle of this brane is determined up to isomorphism by the requirement that 
F + B\m = 0-) Classically, on the support of this brane, z is bounded below or above by 
//. 

Quantum mechanically, there must be a lowest weight or highest weight vector. The 
Jz eigenvalue s_ of a lowest weight vector is determined by — 1) = = ~l)/4 

or 

s- = (3.45) 



The spectrum is exactly as in (|3.25| ), with n replaced by /3. For non-integral n, Jz is no 



longer a half-integer. What we get this way is a unitary representation of the universal 
cover SL{2,M) of 5'L(2,M). It is the generalization of the discrete series to S'L(2,]R). See 
2^ for more. 



3.7. Harish- Chandra Modules From Branes 

Our next goal is to describe in terms of branes the not necessarily unitary represen- 
tations that were described algebraically in section 3.5, for example in eqns. ( |3.38| ) and 
( p.39|) . These are representations in which the spectrum of Jz is of the form s + n, for 
some complex constant s and for n ranging over a sequence of consecutive integers that 
may be infinite, semi-infinite, or finite. Such representations are known mathematically as 
Harish-Chandra modules. (Sometimes one considers only the case 2s G Z, corresponding 
to representations of S'L(2,R) rather than a cover, but we will not make this restriction.) 

In general, Harish-Chandra modules are not unitary, so we will have to describe them 
via branes that are not r-invariant. Harish-Chandra modules do admit an action of the 
group S'L(2,M), though in general not a unitary action. This suggests that we might 
describe them via SL{2, ]R)-invariant branes, but in fact, the full list of SL{2, M)-invariant 
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Lagrangian submanifolds of Y is very short and we have exhausted it aheady. However, 
since sufficiently well localized Hamiltonian isotopies act trivially in the ^-model, it suffices 
for our purposes to consider branes that are 5'L (2, IR) -in variant only asymptotically. It 
turns out that there is a sufficient supply of these. 

Since Jz can be naturally diagonalized in these modules, it is reasonable to guess 
that one can choose the brane B' to be invariant under the subgroup K = ^7(1) = 5*0 (2) 
generated by Jz- K is a maximal compact subgroup of SL{2,M.). 

As we will see, it is possible to describe all K-invariant Lagrangian submanifolds of 
Y. It is convenient to use the fact that Y admits a family of hyper-Kahler metrics with 
parameters (a, 7), as described in section 3.1. The hyper-Kahler metric is not SL{2, C)- 
invariant, but it is invariant under the maximal compact subgroup SU{2) C SL{2, C) and 
in particular under the maximal compact subgroup K = ^7(1) C SL{2,M.). The moment 
map for the K action gives three natural functions on Y, which we denote as w. (Thus 
the components of w are the moment maps for K with respect to the three symplectic 
structures uj = {u!i,u!j,ujk)-) Mapping a point in Y to the corresponding value of w gives 
a map tt : Y ^ R^, which away from the fixed points of K is a fibration with fibers. 
The hyper-Kahler metric of Y takes the form 

ds'^ = Hdw-dw + H-\dx + af (3.46) 

where x = x -|- 27r is an angular parameter along the fibers of tt. The group K acts by 
translation of x or in other words by rotation of the fibers. H is the harmonic function 

H=-J-^ + -^^^ (3.47) 
2\w — w*\ 2\w + w*\ 

The moduli of the hyper-Kahler metric are contained in the choice of point w* G M'^: 

w* = ^{a,(3,^). (3.48) 

This formula will be explained shortly. At the two points w = ±w*, vanishes and 
the fibers of the map y — > collapse to points. Those points are the fixed points of K. 
Away from those two points, the map y — > is a circle fibration and a is a connection 
on this fibration with curvature 

V X a = VH. (3.49) 
What we have just described is the Gibbons-Hawking form of the Eguchi-Hansen metric. 
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Fig. 2: The space oi w G M'^. The tri-holomorphic action of K = U{1) has fixed 
points at the two "Taub-NUT centers," w = ±w* , where w* = |(a, /3, 7). The 
inverse image in Y of a straight line connecting these points is a two-sphere S. 



The three Kahler forms on Y are 

= [dx + d ■ dw) A dw — -Hdw x dw (3.50) 

where {dw x dw)i = tijkdwj A dwk- As a check, we note that with the action of K 
corresponding to the vector field d/dx, the moment map for K is indeed 

p = w, (3.51) 

as promised. A convenient choice of a two-surface S that generates the second homology 
of Y is (fig. 2) the inverse image in y of a straight line in from w = —w* to w = w* . A 
short calculation shows that JgUj/27r = 2w* , justifying the formula ( ^.48| ) for the moduli. 

Finally, we want to understand the action of r and r. For r or r to be a symmetry, 
they must either (1) leave fixed the two points w = ±w* , which occurs if a = 7 = 0, or 
(2) exchange them, which occurs if /3 = 0. 

r and r both commute with K, and transform the symplectic forms by (w/, Wj, ljk) 
(— w/, cuj, —ujk)- Since w is the moment map, this means that r and r acts on the base of 
y ^ by (1^1,^2,^3) {—wi,W2,—ws). Consequently, any K-invariant A-brane that 
is pointwise r or r-invariant must project under tt : y — to the W2 axis, or a piece of 
it. 

Given that r and r commute with rotations of the fiber and square to 1, they can, 
roughly speaking, only act on % by x — > x or % — > % + tt. Let us first discuss case (2), with 
(3 = 0. This is the case that is related to the principal series, and we know from section 
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3.4 that there is a (pointwise) r-invariant A-brane with topology M x S"^. This brane must 
project to the fuU W2 axis. Hence, r must leave x fixed in this case. On the other hand, 
for /9 = 0, 7 7^ 0, there is no such r-invariant A-brane, so r must act by x X + ^- Thus, 
for /3 = 0, we have 

^ :X ^ X + TT 

(3.52) 

^ :X ^ X- 

On the other hand, consider the case a = 7 = 0, > 0. The two fixed points are 
at {wi,W2jWs) = ±|(0,/3,0). From section 3.2, we know that there is an 5'f/(2)-invariant 
brane with topology 5''^ on which r acts trivially. This brane must project to the part of 
the W2 axis connecting the two fixed points. On the other hand, from section 3.3, we know 
that there are two r-invariant branes with topology M^. These must correspond to the 
regions W2 > /3/2 and W2 < —13/2 of the W2 axis. The action on x of r and r is therefore 



r : X 
r ■ X 



[ X + TT 


\W2\ 


>/3/2 


[x 


\W2\ 


</3/2 


fx 


\W2\ 


>/3/2 


IX + TT 


\W2\ 


</3/2 



(3.53) 



For /3 ^ 0, (|3.53| ) and ( p.52|) coincide, as expected. In ( |3.53|) , we have not explained what 
happens for \w2\ = 13/2; these are the fixed point of K so the value of x is immaterial there. 

Now let us consider y as a symplectic manifold with symplectic form ujy = ujk = 
{dx+a-w)Adw3—H dwiAdw2, and try to describe the K-invariant Lagrangian submanifolds 
M. K-invariance means that M is a union of fibers of the projection 1" ^ M'^. So in fact, 
M must be the inverse image in y of a one-dimensional curve £ in M^. The restriction of 
ujy to such an M is the same as the restriction of dx A dws, and vanishes if and only if £ is 
at a constant value of w^- So to find M, we specify a constant value of W3, which we call 
6, and we let C M.^ be the plane defined by W3 = b. Then we pick any curve £ C M^, 
and take M to be its inverse image in Y. 

The plane may contain zero, one, or two of the special points w = ±w* . 
contains one special point if (3/2 = ±6, and both special points if 6 = /3 = 0. In fig. 3, we 
sketch a case in which both of the special points are contained in M^; in this example, i 
extends to infinity in both directions. Although a closed curve i will lead to a Lagrangian 
submanifold, it does not generally lead to an A-brane. The reason is that a closed curve in 
is the boundary of a disc instanton (holomorphic in complex structure K) , so that such 
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Fig. 3: A K-invariant Lagrangian submanifold M C y is represented by a planar 
curve £ eRl. Plotted is the case that contains both special points, depicted 
here as solid dots. 

a Lagrangian submanifold is not likely to be the support of an A-brane.i On the other 
hand, it is definitely possible for i to terminate at one or both ends at one of the special 
points w = ±w* , where the fiber of the map y ^ collapses to a point. 



Fig. 4: If i is semi-infinite, running from a fixed point to infinity, then the corre- 
sponding Lagrangian submanifold is a semi-infinite cigar, equivalent topologically 
to R2. 

There are thus three topologies for M: 

(1) If i connects the two points w = ±w* , the fiber collapses at both ends and M is 
topologically a two-sphere. 

^ Also, the space of {Bcc,B') strings cannot have an interpretation in terms of quantization if 
^ is a closed curve, because the condition for nondegeneracy of ujj that we discuss shortly cannot 
be satisfied for a closed curve. 




M 
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(2) If i is infinite at one end, and ends at the other end at one of the two special 
points, then the fiber collapses at one end and M is topologically R^. (This is illustrated 
in fig. 4.) 

(3) If i is infinite at both ends, the fiber never collapses and M is topologically R x S-*^. 

We have already met ^d-branes of all three types. In section 3.2, we associated finite- 
dimensional representations of SU{2) with branes of type (1). In section 3.3, we associated 
the discrete scries with branes of type (2). And in section 3.4, wc associated the principal 
series with branes of type (3). All of these branes have their support on the W2 axis, with 
wi = ws = 0. Asymptotic SL{2, M) invariance means that at infinity, if £ does get to 
infinity, £ must be sufficiently close to the W2 axis. We do not know the right criterion for 
"sufficiently close," and our results will not depend on this very much. For simplicity, we 
will consider the case that wi is bounded at infinity. 

For the space of {Bcc, B') strings to have an interpretation in terms of quantization, ojj 
must be nondegenerate when restricted to M. Since uj = {dx + a-w) A dw2 — Hdws A dwi , 
and dw3 = along £, this is equivalent to saying that dw2 is everywhere nonzero along 
£. In other words, W2 is everywhere a good coordinate along £, and £ can be described 
by an equation wi = f{w2), for some function /. Hamiltonian transformations of Y that 
commute with K can include, as a special case, area-preserving transformations of that 
leave invariant the fixed points w = ±w* (if either of these points lies in R^). Modulo such 
a transformation, the only invariants of £ are whether it ends at a fixed point and whether 
it goes to the left or right of such a point. 

Let us consider an £ that is infinite at both ends and asymptotically parallel to the W2 
axis. Thus, the Lagrangian submanifold M is topologically M x S'^ . £ may have complicated 
wiggles, but these are irrelevant in the A-model. To find the parameters in the A-model, 
we simply observe that as the first Betti number of M is 1, a rank 1 A-brane supported 
on M depends on a single complex parameter or a pair of real parameters. One real 
parameter is the Wilson line - the holonomy of the Chan-Paton line bundle around S^. As 
in section 3.4, we parametrize the holonomy of this bundle as exp(2ni6) . Then 6 is one real 
parameter characterizing a rank 1 A-brane supported on M. The second real parameter 
corresponds to a displacement of M by the vector field V = ujy^C, where C is a closed but 
not exact one-form on M, and uy = ojk is the symplectic form of the ^-model. In the 
case at hand, we can take C = dx + a-dw (which is closed when restricted to M), in which 
case V is the vector field d/dw^, which shifts b. Thus, the second modulus is simply b. 
Moreover, the ^-model is holomorphic in 5 + ib. 
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It is not hard to understand the meaning of the moduh. In quantizing M with respect 
to symplectic structure loj, the moment map for the K symmetry is W2, which thus plays 
the role of z in sections 3.3-4. W2 is unbounded below along M, since i is asymptotically 
parallel to the W2 axis. So the spectrum of Jz eigenvalues in quantization of M is of the 
form {s + n\n G Z}, for some complex number s that is defined modulo 1. As in section 3.4, 
the real part of s is determined by the monodromy around of the Chan-Paton bundle 
of M = M X 5"^. Thus Re s = 6 + constant, so holomorphy of the A-model in S + ib implies 
that 

s = S + ib + constant. (3.54) 

Now let us discuss what sort of branes are associated with modules that have a highest 
or lowest weight vector. For this, i should end on one of the fixed points w* = ±|(q;, /3, 7), 
and hence (taking the positive sign) we must have 

6 = 7/2. (3.55) 

According to ( |3.11j ), 

fx = (3 + i'j = r] + ij + n, (3.56) 

with n an integer. Comparing the last three formulas, the imaginary part of n is twice the 
imaginary part of s, so via holomorphy, we have IJ./2 = s+71+constant. The constant is 1/2, 
since, as we explained in section 3.3, a highest or lowest weight module with ^ = /3 = 7 = 
has s = 1/2. So the quadratic Casimir operator is 

J2 = (^2 _ ^y^ + 1/2)2 _ 1/4 ^ ^ ^ ^ ^ (^3 57) 

which is the expected result for a module with a lowest or highest weight vector. 

It is inevitable that there is an undetermined integer n in this formula, since s (which 
is defined by saying that the eigenvalues of Jz are congruent to s mod Z) is only determined 
modulo an additive integer. Moreover, the derivation involved no input that would dis- 
tinguish a representation containing a highest weight vector from one containing a lowest 
weight vector. For a brane to have an interpretation in terms of quantization, W2 must be 
a monotonic function along i, so either £ runs from zi;2 = — C)0 to the fixed point or it runs 
from the fixed point to W2 = +00. Since the value of W2 is a classical approximation to 
Jz, the two types of brane correspond to highest weight and lowest weight representations, 
respectively. In either case, to determine the precise Jz value of the highest or lowest 



50 



weight vector, we must treat the quantization more precisely, or use an algebraic argument 
such as that explained in section 3.5. 

If one end of £ is at a fixed point (fig. 4), the corresponding Lagrangian submanifold 
M is topologically M^. The first Betti number of M vanishes, so the corresponding brane 
B' has no deformations as an A-brane. This is what we expect for a brane associated to a 
highest or lowest weight representation. The value of s for such a brane is constrained to 
obey ( p.57|) for some integer n, so there is no possible deformation. ( is a property of the 
space y, not the brane B' , so will remain fixed in deformations of B' in the A-model of 
Y.) 

Now let us consider a pair of curves li and £2, both ending at the fixed point. We 
suppose that £1 runs from —00 to the fixed point and £2 from the fixed point to +00. £1 
and £2 correspond to A-branes Bi and B2 that are associated, respectively, to a highest 
weight representation Ri and a lowest weight representation R2 of s[(2,M). Bi and B2 
are supported on Lagrangian submanifolds Mi and M2, each of which is topologically M^. 
The two copies of M? meet transversely. In terms of some local complex coordinates u and 
V (which we can take to be holomorphic in complex structure J), Mi is defined by f = 
and M2 by w = 0. 

Consider the reducible A-brane B' = Bi ® B2, which is associated to the reducible 
representation R = i?i © i?2, in which Jz is bounded neither above nor below. It is 
supported on M = Mi U M2 , which is defined by the equation 

uv = 0. (3.58) 

What are the deformations of B' as an A-brane? The space of first order deformations 
is the space of {B', B') strings of ghost number 1, which for B' = Bi® B2 decomposes as 
®fj^iHij^ where Hij is the space of {Bi,Bj) strings of ghost number 1. Hu and H22 are 
each trivial, since the first Betti numbers of Mi and M2 are trivial. On the other hand, 
as Ml and M2 intersect transversely at a single point in Y, which is of codimension 4, the 
spaces 7-^12 and 7-^21 are each of complex dimension 1. A general deformation of B' is thus 
given by a pair of complex parameters a G H12 and b G 7^21- 

If a = 6 = 0, remains as a direct sum. If a 7^ 0, 6 = 0, or a = 0, 6 7^ 0, then B' is 
deformed to an extension in one direction or the other, containing Bi or B2 as a sub-brane. 
This gives us three representations, with the same value of s, exactly in parallel with the 
situation that was described in section 3.5, for example in eqns. (|3.40| ) and ( |3.41| ). In fact, 
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the parameters a and h in the present derivation with branes correspond to and in 
the previous purely algebraic analysis. 

Finally, if a and h are both nonzero, the support of the brane B' is deformed from 
uv = Q to uv = e, where e ~ ah. The support of the deformed brane is topologically 
M X 5"^, with first Betti number 1. So it is possible to turn on a monodromy parameter 
5. Of the three real parameters 5, Ree, and Ime, two (namely 5 and, say, Ime) represent 
a deformation in s away from its initial value that obeyed eqn. ( |3.57| ). This deformation 
forces the brane and the associated representation to become irreducible. (Indeed, when 
e 7^ 0, the brane no longer passes through the fixed point at m = f = 0; when 5 is varied, 
the different components are linked by a monodromy.) The third real parameter, say Ree, 
represents a displacement of £ = £i U £2 in the wi direction. This type of displacement 
is irrelevant in the topological A-model, though it is meaningful as a deformation in the 
underlying sigma-model of Y . 

One can go one step farther and consider a situation in which I terminates on a fixed 
point at each end; in other words, £ connects the two fixed points at w = itZJ*. This leads 
to the same derivation with w* replaced by —w*, and s replaced by —s in ( |3.57| ). Requiring 
that ( p.57|) should hold for both signs of s, we learn as usual that 2s G Z. The associated 



representations are finite- dimensional. We studied them from the viewpoint of SU{2) in 
section 3.2, and we will re-examine them in section 3.8 from the viewpoint of SL{2, M). 

3.8. T -Invariant Branes With Only Asymptotic SL{2,'R) Symmetry 

Here we will study a more general class of r-invariant A-branes associated to s[(2, M) 
representations that admit a hermitian structure that may or may not be positive-definite. 
Thus, we will re-examine in terms of branes questions that were considered algebraically 
at the end of section 3.5. 

We continue to describe y in a manifestly SL{2, ]R)-invariant way by the equation 

-x^ -y2 4-^2 ^ (3.59) 

In this description, r and r act by 

r : {x,y,z) (-x, -y,z) 

(3.60) 

r : ix,y,z) {x,y,z). 

We begin with the case > 0. For the compact cycle 5" that generates the second 
homology of y, we can take the fixed point set of r. In the present description, this 
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fixed point set is characterized by {x,y,z) = {ix,iy,z), where x,y, and z are real and 
x"^ +y'^ + z'^ = iJp'/A. 

Let B' be a rank one ^-brane supported on S. Since r acts trivially on S', the space 
Ti. of {Bcc,13') strings gives a unitary representation of SU{2), a fact that we exploited in 
section 3.2. 

Here wc will look at the same brane from the point of view of SL{2, C) and eventu- 
ally SL{2,M.). First of all, the set 5" is not 5'L(2, C)-invariant. Nevertheless, the A-brane 
B' is 5'L(2, C)-invariant, simply because S is compact. For v G s[(2,C), let hy be the 
Hamiltonian function that generates the vector field on Y corresponding to v. Let hy 
be any function on Y of compact support that coincides with hy in a neighborhood of 
S. The action of hy is trivial in the yl-model (since Hamiltonian isotopies of compact 
support are trivial in the ^-model) and this action on B' coincides with the action of 
hy. (We could make a similar argument concerning the action of an element of the group 
SL{2, C) that is close to the identity.) This argument still goes through if S is not com- 
pact but is asymptotically 5'L(2, C)-invariant. For example, we will presently consider a 
Lagrangian submanifold that is S'L(2, C)-invariant on the complement of a compact set. 
This is certainly an adequate condition. 

Since the brane B' is S'L ( 2, C) -invariant, the group 5'L(2, C) must act on H. In- 
deed, in any finite-dimensional representation of SU{2), the representation matrices can 
be analytically continued to give an action of SL{2, C). (By contrast, the group SL{2, C) 
will generally not act in a Hilbert space that furnishes a representation of S'L(2,]R), even 
a unitary one; such representations are generally associated to branes whose support is 
non-compact in an essential way, and the above argument does not go through.) 

Though SL{2, C) acts on the Hilbert space H obtained in quantization of S, it cer- 
tainly does not preserve the positive-definite hermitian structure of H that arises from r 
symmetry. In fact, SL{2,C) does not preserve any hermitian structure on H. However, H 
does admit an S'L(2, R)-invariant hermitian structure (though not a positive one). 

The reason for this is simply that S is r-invariant, as well as r-invariant. r acts on S 

by 

(x, y, z) {-X, -y, z). (3.61) 

T does not leave S fixed pointwise (as r does), but it does map S to itself, and therefore 
maps B' to itself. So the construction of section 2.4 can be applied using r symmetry to 
get a manifestly S'L(2, R)-invariant hermitian structure on H. 



53 



By following the logic of eqn. (|2.18| ), we can make this explicit. If ( , ) is the natural 
pairing between {Bcc,B') strings and {B'.Bcc) strings, then the 5'C/(2)-invariant hermitian 
pairing is {i^^i^') = (OrV'^V'') and the S'L ( 2, M) -invariant pairing is {{i/j.^fj')) = (G-?/', ?/''). 
Here Or = tO and 0~ = rO. Finally, r is the same as /ir, where h is the rotation in 
( p.61|) , which acts on the Lie algebra sl(2, C) the same way that it does on the coordinates: 

h{j^, Jy, Jz)h~^ = (- J^;, - Jy, ) . (3.62) 

So the relation between (( , )) and ( , ) is 

{{^i,i^2)) = {hi^i,^2). (3.63) 

Explicitly, we can now verify that (( , )) is S'L ( 2, M) -invariant. Since Jx,Jy, and Jz are 
hermitian with respect to ( , ), ( p.62| ) implies that Jz is hermitian but Jj; and Jy are 
antihermitian with respect to (( , )), which is the condition for 5'L(2, ]R)-invariance. 

The fact that the same representation admits hermitian forms invariant under either 
SU{2) or SL{2, M) is related to the fact that these groups are "inner real forms" of SL(2, C). 
This means the following. SL{2, M) is the subgroup of S'L(2, C) characterized hy g = 'g 
(where we regard g G S'L(2,C) 2 complex unimodular matrix), while SU{2) is 

characterized hj g = hgh~^. An "outer form" (there are none for 5'L(2,C)) would be 
characterized hj g = 4'{'g), where g — > (p{g) is an outer automorphism of order 2. 

Let us describe the hermitian form (( , )) more explicitly in a basis of eigenstates of 
Jz- First consider a representation of odd dimension n = 2k + 1. We diagonalize Jz with 



Jzil^s = sips, s = —k, —k -(- 1, . . . , /c. Eqn. (|3.62| ) determines h up to multiplication by a 



constant c, which for the moment we will assume to be real: 

hiPs = c{-iyiPs. (3.64) 

So the sign of {{i/js^i^s)) is c(— 1)*. Thus the states i/js have alternating positive and 
negative norms. We have actually seen this structure from an algebraic point of view in 
section 3.5, in a problem (see eqn. ( p.44| )) that is closely related, as will become clear. 

The value of c depends upon how one lifts r from an automorphism of Y to an 
automorphism of the relevant Chan-Paton line bundles. When one has a hermitian form 
that is positive-definite if the sign is chosen properly, that gives a natural choice. Otherwise, 
what is natural may depend upon the problem. One fairly natural way to pick a lift of r is 
to pick a fixed point p E S of t, assuming that there is one (in the present case there are 
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two fixed points p± defined by (x, y, z) = (0, 0, ±^/2)), and require that r acts trivially on 
the fiber at p of the relevant Chan-Paton bundles. This gives a definite recipe for defining 
the hermitian form, but in general it depends on the choice of p. 

A further subtlety arises for an even-dimensional representation of SU{2). In this case, 
since s is half-integral, in order to make {(ifj^il))) real- valued, we need to pick c imaginary 
(which will ensure that the eigenvalues of h arc real). Here it is fairly clear that there 
cannot be a preferred choice between c — i and c = —i. Indeed, it can be shown that in 
the recipe mentioned in the last paragraph, the sign depends on the choice of fixed point 
P±- 

The Complementary Series 

We return to the framework of section 3.7 and we consider an ^-brane associated with 
a suitable curve £. However, here we will take £ to be simply the W2 axis, wi = W3 = 0. 
For = 0, 7 7^ 0, this gives the brane, studied in section 3.4, whose quantization leads to 
the principal series. Here we will consider the opposite case a = 7 = 0, /? > 0. We take B' 
to be a rank 1 A-brane supported on M = 7r~^{£). 

In this case, the two fixed points of K lie on £ at the points ±|(0, /3, 0). Hence, geomet- 
rically one can divide M into three pieces = R^, Mq = S'^, and M_ = M?, respectively, 
corresponding to W2 > (3/2, (3/2 > W2 > —(3/2, and W2 < —(3/2. Corresponding to this, if 
the parameters are chosen correctly, B' may be the direct sum of three yl-branes B+,Bo, 
and B-. 

For this, we need 77 = and P equal to an integer n, so that an ^-brane with support 
Mo exists. (Recall from section 3.2 that the space of (BccBq) strings has dimension /?.) 
The decomposition B' = B+®Bo®B_ further needs a condition on the Chan-Paton bundle 
of B'. The monodromy around the point of intersection of M+ and Mq (or of Mq and M_) 
must be trivial, or else this monodromy will link the different components. 

Though it is possible for B' to have a decomposition as an A-brane, this is not the 
main situation that we wish to discuss. We will primarily be interested in parameters for 
which B' is irreducible. Actually, for brevity we will focus on the case of s = 0, leading to 
representations of SL{2, M) in which the center acts trivially. One can achieve s = for any 
P or by suitably adjusting the monodromy of the Chan-Paton bundle. If s = 0, then 
the representation of SL{2, IR) is irreducible unless = n{n+ 1) for some integer n. When 
this occurs, quantization of Mq gives a Hilbert space of dimension 2n+l. This happens 
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for /3 = 2n + 1. (For s = 1/2, the representation becomes reducible for = n{n + 1) with 
n G Z + 1/2; this happens for even jS. We leave this case to the reader.) 

Let us discuss the space H of {Bcc, B') strings. First of all, M_|_ and M_ are SL{2, M)- 
invariant, though Mq is not. But Mq is compact. So we are in a situation similar to 
the one we encountered above: since M is SL{2, ]R)-invariant away from a compact set, 
SL{2, M) acts naturally on Ti. Furthermore, this action preserves a hermitian form (though 
not necessarily a positive-definite one) since M is r-invariant. In fact, r acts trivially on 
the components M±, while rotating the two-sphere Mq by an angle tt around its points of 
intersection with M±. These statements have essentially been summarized in eqn. ( |3.53|) , 
according to which r acts on the fiber of tt : y by 

We consider first the case that (3 is large, to get a useful semiclassical description. 
Also, we take s = 0, so as to get a representation of SL{2,M.) with integer eigenvalues 
of Jz- AH integers will appear, since the moment map of Jz, which is W2, is unbounded 
above and below on M. So Ti has a basis i(;n with Jzi/^n = nt/jn- Semiclassically, M+, 
Mo, and M_ support, respectively, states with Jz (or its moment map W2) greater than 
(3/2, between (3/2 and —(3/2, and less than —(3/2, respectively. Quantization of M_|_ or 
M- gives a positive-definite hermitian form, since r acts trivially, while quantization of 
Mo gives an oscillatory quadratic form, as described above. So the norm of i/'n is positive 
for |n| > (3/2 and oscillates in sign for \n\ < (3/2. Semiclassical reasoning justifies these 
statements except near |n| = (3/2, where the fact that B' is actually irreducible becomes 
relevant. But actually, the algebraic analysis of the hermitian form in section 3.5 shows 
that the statements are precisely valid. 

Now let us consider the opposite region in which (3 is small, still keeping s = 0. At 
/3 = 0, M coincides with the brane used in section 3.4 to describe the 7 = case of the 
principal series. The hermitian form on Ti is certainly positive-definite in that case; in 
fact, r acts trivially on M at /3 = 0. When we turn on (3, = (/3^ — 1)/4 becomes greater 
than —1/4. The SL{2,M.) action on Ti. remains irreducible until we reach (3 = 1. In this 
entire range, there is no highest or lowest weight vector (eqns. ( p.35|) and (|3.36| ) show that 
for s = and < 0, there cannot be one), and the hermitian inner product remains 
positive-definite, according to eqn. ( |3.44] ). What we have found is the complementary 
series of unitary representations of 5'L(2,R). 
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At /3 = 1, the brane B' is reducible. H splits up accordingly as 7i_|_ © Hq © 
where T-C± are infinite- dimensional Hilbert spaces that realize the discrete series represen- 
tations D^, and Tio is a one-dimensional trivial representation of SL(2, M). The hermitian 
structure on H+ © Hq © H- is not unique, as signs can be chosen independently on the 
three summands, depending on the lift of r to act on the Chan-Paton bundles of the three 
branes. Continuing past (3 = 1, the hermitian structure becomes unique again (up to a 
multiplicative constant, which we choose to get an almost positive-definite inner product), 
with a single state of negative norm. This follows from the algebraic analysis of section 3.5 
(see eqn. ( |3.44|) ). This result means that the hermitian structure at /3 = 1 that continues 
smoothly to /3 > 1 corresponds to taking the hermitian form on Tio, and Ti- to be 
respectively positive, negative, and positive. 

If we continue to increase /3, the brane B' and the representation furnished by Ti. are 
irreducible, as noted above, except when jS is an odd integer 2n + 1, for some n. For /3 
between 2n — 1 and 2n + 1, the number of negative norm states is n, according to the 
algebraic analysis of section 3.5. At (3 = 2n + 1, H decomposes as Ti.+ © Ho © 7i-, where 
T-C± furnish discrete series representations, and TYq is a representation of dimension 2n + 1. 
Taking a basis of Hq with Jzi^k = ki(>ki \k\ < n, the norm of i(>k has sign c(— 1)'^, as 
explained earlier, where depending on the choice of lift of r, c may be either 1 or —1. One 
lift gives n states of negative norm and one gives n + 1. The lift that gives n states of 
negative norm continues smoothly to /3 < 2?! + 1 and the one that gives n + 1 states of 
negative norm continues smoothly to P > 2n + 1. The fact that one lift extends in one 
direction and one in the other can be explained by a topological argument. 

3.9. Relation To V -Modules 

In section 3.7, we showed how to describe a Harish-Chandra module in terms of a 
curve I in the plane M^. We adopted as much as possible a topological point of view, not 
attempting to make a distinguished choice of I. Instead we required only that W2 is a good 
coordinate along so that the space of (-Bcc, B') strings in the A-model can be related to 
quantization of M. 
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Fig. 5: A vertical line in the plane M^, corresponding to a brane of type {A, B,A). 



However, certain choices of £ have particularly nice properties. One choice that is 
particularly nice from the point of view of quantization is to take £ to be a vertical line 
(or part of a vertical line) in the plane M^. In this case (fig. 5), M = n~^{i) is a complex 
manifold in complex structure J. The associated A-brane B' is then a brane of type 
[A, B, A) (that is, it is a S-brane with respect to complex structure J and an A-brane for 
any linear combination of and ujk)- This can be convenient, for the following reason. 
The canonical coisotropic brane Bcc associated with a choice of hyper-Kahler metric on 
Y is also a brane of type (A, S, A). The space of {Bcc, B') strings in the A-model can be 
viewed as the space of string states of zero energy in the underlying sigma-model of Y with 
A/" = 4 supersymmetry, or alternatively as the {Bcc, B') strings in the S-model of complex 
structure J. In other words, quantization in our sense coincides in this situation with what 
in geometric quantization is called quantization using the Kahler polarization determined 
by J. We exploited this relationship in section 2.3. 

There is another type of choice for i (fig. 6) that is not closely related to quantization 
but is interesting from a different point of view. We take i to run horizontally in M^, 
parallel to the wi axis. In this case, M is holomorphic in complex structure / and B' is a 
brane of type (S, A, A). This choice of M is maximally unsuitable for an interpretation via 
quantization, because ujj vanishes when restricted to M, rather than being nondegenerate. 
However, it has another virtue: it simplifies the relation between A-branes and P-modules. 

Y can be interpreted as T*CP^ if « ^ 0, = 7 = 0; more generally if f3 and 7 
are not zero, Y is an affine deformation of T*CP^. In any event, Y admits an SL{2, C)- 
invariant holomorphic map \E' : y — CP^ (in fact two such maps, related in a sense by a 
Weyl transformation; explicit formulas are given below). In this situation, as explained in 



58 



Fig. 6: A horizontal line in the plane R^, corresponding to a brane of type 
{B,A,A). 



section 11 of 0, the space of {BccS') strings can be sheafified over CP^ and interpreted 
as the sheaf of sections of a twisted "D-module over CP^. The P-module is twisted by 
-fC^/^ 0{1)^, where K is the canonical hne bundle of CP^, 0{1) is the usual line bundle 
of degree 1, and X = t] + i'j. (Such twisting is described in [|2^, section 4.4.) 

The fact that an A-brane leads to a twisted P-module, as well as an s[(2, C) module, 
enables us to make contact with the theory of Beilinson and Bernstein ||2^] relating s[(2, C) 
modules to twisted X>- modules on the flag manifold CP^. To compare to that theory, we 
would like to be able to explicitly describe the P-module corresponding to a given A-brane. 
In general, this is difficult, but for branes of type {B,A,A), there is a natural framework 



for doing so, as described in section 4.3 of |]2^. In general, this involves solving Hitchin's 
equations, but for the branes considered in the present paper, one can get an explicit 
answer as the relevant equations are abelian. 

If B' is a brane of type [B, A, A) supported on M cY (so in particular M is holomor- 
phic in complex structure /), then the support of the corresponding P-module is simply 
the projection of M under the holomorphic map : Y CP^. In order to describe 
explicitly, we recall that, in complex structure /, the complex symplectic manifold Y is 
defined by the equation +y'^ + z"^ = fJ,^/4: in complex variables x, y, z. To an element of 
Y, we associated a complex 2x2 traceless matrix 



A 



(3.66) 



X y — iz 
y + iz —X 

with determinant — /x^/4 or, equivalently, with eigenvalues ±/Lt/2. Because /x/2 is an eigen- 
value of A, there exists a nonzero column vector T, unique up to scaling, that obeys 



AT = ^T. 
2 



(3.67) 
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Up to scaling, T determines a point in CP^, and \1/ is defined to map A to this point. (A 
second such map can be defined by taking T to obey AT = — (/x/2)T.) Setting T = 



gives 



t 



fx/2 — z X + iy 



(3.68) 



X — iy /j,/2 + z 

This formula explicitly describes the map \E' : y — CP^. In terms of new variables 
x± — ±x + iy, we have 



t 



z — x+ 



X- fi/2 + z 
In terms of these variables, the equation defining Y becomes 



(3.69) 



x+X- = z^ — 



(3.70) 



The variable z here can be identified with the complex variable W2 + iwz in the Gibbons- 
Hawking description of the hyper-Kahler metric on Y . 




Fig. 7: A brane B' of type {B, A, A) is located at a fixed value of z = W2 + iws. 



Now let us return to branes of type (S, A, A). As we explained in section 3.7, in the 
Gibbons-Hawking description of the hyper-Kahler metric on Y, a brane B' of type [B, A, A) 
is represented by a curve £ C with fixed values of W2 and ws. In other words, £ is a 
line parallel to the wi axis, or a part of it. In particular, since the value of z = W2 +iws is 
fixed, the support of this brane is a complex subvariety of Y defined by a constant value 
of + y"^ or equivalently of x+X-: 

x+X- = e. (3-71) 
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Here e = — + is a constant that vanishes precisely if z = ±^/2. 
Unbounded Modules 

We start with the general case e 7^ 0. In this case, M is an irreducible algebraic curve 
defined by eqn. ( p.71|) . It has the topology of R x 5"^ and corresponds to a principal series 
representation of 5'L(2,]R) or its universal cover, or, more generally, to a Harish-Chandra 
module that has Jz eigenvalues unbounded above and below. From (|3.69|) it follows that 
a brane B' of this type corresponds to a P-module supported on 

M' = CP^ \ {0,00}. (3.72) 

Because the map from M to M' is 1 : 1, the P-module is of rank 1, and is given by 
a flat bundle with structure group C* = G'L(1, C). As tti{M') = Z, such flat bundles are 
classified by a single element of C*, which we can take to be the monodromy around the 
origin (or the inverse of the monodromy at infinity). The logarithm of this monodromy 
corresponds to the parameter s = 5+ib of section 3.7. If the projection of M to its image in 
CP^ were /c : 1, we would have to solve rank k Hitchin equations to describe the P-module 
explicitly. 

M' is one of the Kc orbits in CP^. Indeed, the complex group Kc = C* acts on the 
flag variety CP^, which is a union of three Kc orbits: two compact orbits {0} and {00}, 
and one open orbit C* ~ CP^ \ {0, 00}. 

Highest And Lowest Weight Modules 



As z approaches one of the points ±(u/2, say /u/2, we have e — > in eqn. (|3.71|) , and 
the brane B' supported on the curve (|3.71|) degenerates into a sum of two branes, one 
supported at = 0, and the other supported at X- = 0. We denote these branes as B'_^ 
and B'_, respectively. (The imaginary part of the condition z = ii/2 is b — 'y which is 
precisely the condition ( |3.55| ) for i to end at a special point.) From ( ^.69] ), it follows that 
the supports of the branes B'^ are 

m; = {0} 

3.73 

M'_ = CP^ \ {00} 

At the second special point, z = — ^/2, the roles of B'_^_ and B'_ are reversed and the branes 
and B'_ correspond to P-modules supported on 

M' = CP^ \ {0} 

(3.74) 

M'_ = {00} 

In both cases, the P-modules supported on and M'_ correspond, respectively, to 
Harish-Chandra modules with lowest and highest weight vectors. 
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3.10. Groups Of Higher Rank 

We have concentrated on SL{2, C) in this section to keep the arguments elementary, 
but there is a fairly immediate analog for any complex Lie group Gc, with Y taken to be 
a coadjoint orbit of Gc, and O the natural holomorphic symplectic form of the coadjoint 
orbit. The algebra A of {Bcc^Bcc) strings in that case is W(gc)/X, where U{qc) is the 
universal enveloping algebra of Gc, and X is a deformation of the ideal that defines Y. 

Suppose that Gc is of rank r. Then the ring of invariant polynomials on Q£ is a 
polynomial ring with r generators Oi, . . . , (9^., which are known as Casimir operators. A 
regular orbit in gc is obtained by setting the Oi to complex constants c^. So if Y is such a 
regular orbit, then the ideal X is generated by Oi — c[, with some constants c^, i = 1, . . . , r 
(which may differ from the classical values c^, as we have seen for rank 1). 

For any Lagrangian A-brane B', the space H of {Bcc, B') strings is a gc-iiiodule in which 
the values of the Casimir operators are Oi = c'^. Thus, just as we saw for the rank 1 case, 
by making different choices of we get many different gc-^iodules with the same values 
of the Casimir operators. Moreover, if B' is invariant under an antiholomorphic involution 
of Y (which leaves fixed the support of then Ti furnishes a unitary representation of 
the corresponding real form of Gc- 

With suitable choices of B' , one can construct unitary representations of the compact 
form of Gc and analogs of the discrete and principal series for noncompact forms, as well 
as mixtures of these. The greatest novelty in going to rank greater than 1 is, however, that 
there are also interesting representations associated with non-regular orbits. For SL{2, C), 
the only nonregular coadjoint orbit is the orbit of the zero element of sl(2, C); this orbit is 
a point, leading to the trivial representation. Groups of higher rank have a greater variety 
of non-regular orbits, leading to non-trivial but in some sense small representations. 



4. Quantization Of Chern-Simons Gauge Theory 

Finally, we conclude by examining one of the few known examples of a quantum field 
theory in which the subtleties of quantization actually play an important role. 

The relevant quantum field theory is three-dimensional Chern-Simons gauge theory. 



It was analyzed in and in more detail in [pl| , |32| , p!5| from the viewpoint of geometric 
quantization, and has been studied from numerous other points of view ranging from 
conformal field theory to algebraic geometry and deformation quantization (references 
include [0, ||3^, and [^, respectively). See ||3^ for an introduction to the theory. 
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The aspect of interest to us is to construct the space of physical states of Chern-Simons 
theory with compact gauge group G on an oriented two-manifold without boundary that 
we call C. For brevity, we take G connected and simply-connected. We define M to be 
the moduli space of homomorphisms from t^i{C) into G, up to conjugation, of a given 
topological type. M (which is the classical phase space of the Chern-Simons theory) has 
a natural symplectic form uj^, inherited from a symplectic structure on the infinite- 
dimensional linear space A of all connections on a G-bundle E ^ C oi the appropriate 
topological type. In gauge theory, letting A denote a connection on i?, the symplectic form 
can be described explicitly by 



^* = TZ / TrM AM. (4.1) 
'c 



4n 



The symbol Tr represents an invariant quadratic form on the Lie algebra g of G, which we 
normalize so that t<;*/27r is the image in de Rham cohomology of a generator of i7^(M, Z) = 
Z. (For G = SU{n), Tr is the trace in the n-dimensional representation.) A line bundle 
with curvature iv^ can be naturally constructed using gauge theory |Q. Then, picking a 
positive integer k, we seek to quantize M with symplectic form u = /ecu* and prequantum 
line bundle C = C'l. 

To find a sigma-model that will do this, we need a natural complexification Y of M, 
with certain properties. We simply take Y to be the moduli space of homomorphisms from 
7ri(C) to Gc, the complexification of G, again up to conjugation. Y is naturally a complex 
manifold. Indeed, Y can be defined by giving the holonomies Ui and V^-, i,j = l,...,g 
around a complete set of a-cycles and 6-cycles in C. These are defined up to conjugation 
by an element of Gc, and obey a single relation 

t/iV^it/r Vf 1 . . . UgVgU;X~^ = 1. (4.2) 

This description makes it clear that 1" is a complex manifold, and in fact an affine variety, 
with a great deal of holomorphic functions. We can describe these functions explicitly. 
Let -R be a finite-dimensional representation of Gc- For S an oriented closed loop on C, 
let Ho^S") be the holonomy of a fiat connection around 5". Then Wr{S) = Tr/j 1101(5") 
is a holomorphic function on Y . (We took R to be finite- dimensional to ensure that 
the trace always converges; for suitable infinite-dimensional R, the same formula gives a 
meromorphic function on y.) In gauge theory, with A now understood as a 0c- valued 
connection, we can write 

WR{S) = TYRPe^^(^- j^A^. (4.3) 
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Alternatively, if we write as a word in the a-cycles and 6-cycles (regarded now as gen- 
erators of 7ri(C)), then Wii{S) is the trace of the corresponding word in the Ui and Vj. 
The holomorphic functions Wii{S) restrict on M to holonomy functions that we define and 
denote in the same way (the holonomies are now G- valued rather than Gc-valued). Thus 
the restrictions of holomorphic functions on Y give a dense set of functions on M. 

Y has a nondegenerate holomorphic two-form that is defined by the same formula 
as (|4.1|) , with A now understood as a gc valued connection. We consider F as a complex 
symplectic manifold with holomorphic symplectic form O = kfl^. Clearly, the restriction 
of to M coincides with w. The line bundle C ^ M extends to a unitary line bundle 
C ^Y with a connection of curvature ReO. 

As usual, we want to consider the A-model of Y with symplectic structure ljy = Imfi. 
(This is the same A- mo del that is studied in the gauge theory approach to geometric 
Langlands [0, though the motivation there is a little different.) y is a space with a very 
good A-model, since in fact [l39[| it can be endowed with a complete hyper-Kahler metric 
extending its structure as a complex symplectic manifold. To find such a hyper-Kahler 
metric, one picks a complex structure on C, which enables one to write down Hitchin's 
equations; one then endows Y with a complete hyper-Kahler metric by interpreting it as the 
moduli space of solutions of those equations. An important point here is that the structure 
of y as a complex symplectic manifold is completely natural (requiring no structure on C 
except an orientation) . But to endow Y with a hyper-Kahler structure, which is useful for 
making the A-model concrete, we have to pick a complex structure on C. The choice of 
such a hyper-Kahler metric is a hyper-Kahler polarization of {Y, M) in a sense described 
in sections 1.3 and 2.3. 

Gc has an antiholomorphic involution that keeps G fixed; we write it as U U and 
call it complex conjugation. We define an antiholomorphic involution t : Y ^ Y that acts 
by complex conjugating all monodromies. M is a component of the fixed point set of r, 
since by definition, M is the locus in Y with G-valued monodromies. (The fixed point set 
of r has other components, as explained in ||39[] .) 

To place quantization of M in the framework of this paper, we must as usual introduce 
two branes in the A-model of Y. One brane is the canonical isotropic brane Bcc, whose 
support is all of Y and whose curvature form is ReO. This brane exists and is unique up 
to isomorphism because we have taken G to be simply-connected and k to be an integer. 
Restricted to M, ReO is the symplectic form uj = ku^ of M, which we wish to quantize. 
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We let B' be a rank 1 A-brane supported on M; it exists and is unique up to isomorphism 
as M is a simply-connected spin manifold. 

The space H of {Bcc, B') strings in the A-model gives a quantization of M with sym- 
plectic structure uj. Diffeomorphisms of C that are continuously connected to the identity 
act trivially on Y and on its A-model. (They do not preserve a hyper-Kahler metric on Y 
that we may use to facilitate computations in the A-model, but A-model observables do 
not depend on this hyper-Kahler metric.) However, the mapping class group Mc of C acts 
on y in a way that is nontrivial (and not isotopic to the identity) so it can act non-trivially 
on Ti. It is useful to introduce the TeichmuUer space T of C. Any point t E T determines 
a complex structure on C (unique up to isotopy) and hence a hyper-Kahler polarization of 
(y, M). We denote as Ht the space of {Bcc, B') strings constructed with this polarization. 
It is locally independent of t, since the A-model is invariant under a local change in the 
hyper-Kahler polarization, so the Tit fit together as fibers of a fiat vector bundle over T. 
Taking the monodromy of the fiat connection, we get an action of Mc on Tit (for any 
choice of t). Actually, to be more precise, as is known from other approaches cited at 
the beginning of this section, what acts on ?i is a central extension of Mc- Though the 
occurrence of a central extension is not surprising in quantum mechanics, to compute the 
central extension from the present point of view, we would need a better understanding of 
how to explicitly construct the fiat connection. 

As explained in general in section 2.3, after a choice of hyper-Kahler polarization 
corresponding to a point t eT ,71 can be computed explicitly as a vector space by taking 
the space of holomorphic sections of the appropriate line bundle, 

n = H^{M,C}^K^/'^), (4.4) 

but the proper Hilbert space structure of the A-model is not given by an elementary 
formula in terms of the Kahler geometry of M. That is actually the standard result in 
Chern- Simons gauge theory; Ti can be constructed as a vector space by taking a suitable 
space of holomorphic sections, but that does not lead to a simple expression for the Hilbert 
space structure. (|4.4| ) can be slightly simplified using the fact that K^^"^ = C~'^, where h 
is the dual Coxeter number of G. (This fact can be proved using the index theorem for 
a family of Dirac operators.) The standard algebro-geometric description of the physical 
Hilbert space of Chern-Simons theory at level k isTi = H^[M^ C^). So k as conventionally 
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defined in gauge theory or two-dimensional current algebra is related to k in the A-model 
by 

k = k-h, k = k + h. (4.5) 

Many formulas in Cher n- Simons gauge theory are most simply written not in terms of the 
underlying coupling k but in terms of k + h, which, as we now see, is the natural A-model 
parameter k. 

The holonomy functions Wfi{S) generate, classically, a commutative algebra. In the 
A-model, this commutative algebra is deformed as usual to a noncommutative algebra A, 
the space of {Bcc, ^cc) strings. This algebra will act on Ti. In Chern-Simons gauge theory, 
what this means is simply that Wilson loops on C, upon quantization, become operators 



that act on the quantum Hilbert space. Some aspects of this were described in for 
more from the point of view of deformation quantization, and additional references, see 

The greatest novelty of the present approach to this much-studied subject is probably 
that it is clear that the very same algebra A acts on the space of {Bcc,B) strings for any 
other choice of A-brane B. Quite a few interesting choices can be contemplated. We 
conclude by mentioning some illustrative examples. 

We have already considered one case, in which i3 is a rank 1 A-brane supported on 
M, and the space H of (Sec, B) strings can be interpreted as a quantization of M. 

Alternatively, since the A-model we are considering here is the same one that is con- 
sidered in the gauge theory approach to geometric Langlands, we can consider A-branes 
that are important in that context. These are rank 1 A-branes supported on a fiber of the 
Hitchin fibration. The Hitchin fibration is a map tc : Y ^ B, where B is an afRne space 
of half the dimension of Y. The map is holomorphic not in the natural complex structure 
of Y with which we began the discussion but in another complex structure i that is found 
by solving Hitchin's equations. A generic fiber F of the Hitchin fibration is a torus that 
is a complex abelian variety from the point of view of this other complex structure. More 
relevant for our present purposes, i*" is a Lagrangian sub manifold from the point of view 
of ujy = ImO, so it can be the support of a rank 1 A-brane B* . Moreover, ReO is nonde- 
generate when restricted to F, so the space H* of {Bcc,B*) strings can be regarded as a 
quantization of F. 



^ This complex structure is called / in [39|. There is a difficult-to- avoid clash in notation with 
section 2, where the analogous complex structure was called J. The notation there was motivated 
by compatibility with the gauge theory approach to geometric Langlands. 
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Since is a torus, one would naively expect quantization of F to be related to abelian 
current algebra, not nonabelian current algebra. However, there should be a close relation 
between Ti. and 7i*, because a certain very singular special fiber of the Hitchin fibration 
(the fiber at the "origin") has M, taken with multiplicity greater than 1, as one of its 
components. This fact should lead to an embedding of Ti. (or possibly of the direct sum 
of several copies of Ti.) in 7Y*, something that is very likely related to various results in 
conformal field theory in which current algebra of the nonabelian group G is expressed in 
terms of an abelian current algebra. 

For a quite different kind of example, let Gm be an arbitrary real form of the complex 
Lie group Gc ■ For any such real form, there is an antiholomorphic involution (p : Gc Gc 
that leaves Gr fixed. Mapping the holonomies Ui,Vj to their transforms by (p gives an 
antiholomorphic involution of Y that we call r^. The fixed point set of has a component 
that is the moduli space of Gu-valued fiat connections on C. If Gm is compact, then 

simply coincides with the space M whose quantization we have already discussed. 

In general, M<^ is the phase space of three-dimensional Chern-Simons theory with 
gauge group Cm, compactified on a two-manifold C. It is a Lagrangian submanifold of Y 
with respect to uy = ImO and supports a rank 1 A-brane B. The space H of {BcciB) 
strings can be interpreted as the space of physical states in quantization on C of Chern- 
Simons theory with gauge group Gr. One interesting consequence of the present point of 
view is that the same algebra A of quantized holonomies that acts in the compact case 
also acts on the space of physical states for any noncompact real form. This is almost clear 



perturbatively (except for a subtlety at the one- loop level ||4C1|| , which we explain shortly), 
but is less obvious nonperturbatively. 

To describe Ti explicitly, we pick again a point t E T, giving a hyper-Kahler polar- 
ization of {Y,M(j)). In other words, after picking t, we solve Hitchin's equations to get a 
hyper-Kahler metric on Y , which determines a complex structure on M<^. Then in this 
hyper-Kahler polarization. Tit is explicitly H^{M(j,, ®i4r^/^), where now K is the canon- 
ical bundle of M^. However, it is not true that K^/"^ = . Rather, K^/"^ ^ C, 



-h 



'I' 



where /i^ is defined as follows. Decompose the Lie algebra of G^ as g = k © p, where k 
is the Lie algebra of a maximal compact subgroup of and p is its orthocomplement. 
After expressing h in terms of the trace in q of the square of a suitable element of g, write 
h = h-^- + h-, where and h- come from traces in k and p, respectively. Then (as one 
can again prove using the families index theorem) h(j, = h+ — h-. We thus have 

'Ht = H\M^,d:-'''). (4.6) 
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We would like to compare this result to Chern-Simons gauge theory, but it is difficult 
to do so because Chern-Simons gauge theory of a non-compact gauge group is not well- 
understood. However, it is a reasonable conjecture that the space of physical states is 
Tit = H^{Mff), Z^**^), where kep is the Chern-Simons coupling. If so, the relation between /c<^ 
and the A-model parameter k is 

k^ = k~h^, k = k^ + h^. (4.7) 

Equivalently, for the same algebra A to act in Chern-Simons theory with compact gauge 
group and coupling k as in Chern-Simons gauge theory with gauge group G-r and coupling 
k(j), the relation between k and /c^ must be 

k + h = k^ + h^. (4.8) 

The couplings are here defined so that the spaces of physical states are H^{M^C^) and 
H^{Mfi), c'l'''), respectively. These formulas are consistent with a computation of the 
one-loop quantum correction in Chern-Simons theory with a noncompact gauge group. 

Either the topological invariance of Chern-Simons gauge theory or the fact that the A- 
model is independent of a choice of hyper-Kahler polarization implies that there should be 
a natural projectively fiat connection governing the dependence of Tit on t. Except in the 
compact case, it is not known how to explicitly construct such a connection. However, for 
Gr a split real form, and a particular component of M (the one that is contractible topo- 
logically) , the appropriate representation of the mapping class group has been constructed 
by another method based on real polarizations Hlf . 
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